Data Engineer
Posted
Summary
Builds data infrastructure and pipelines for customer-facing products, including data integration, large-scale pipelines, workflow management, and ML/AI real-time inference; implements experimentation platform using Java/Scala/Python and big data technologies like Spark, Kafka.
What will you do
- Work closely with the team of engineers, strategists and data scientists to build customer-facing products to address business problems.
- Build state-of-the-art data infrastructure to unlock full potential of ABACUS digital' data analytics capabilities. This includes, but not limited to, data integration (from both internal and external sources), large-scale data pipelines, data workflow management, and ML/AI real-time inference service.
- Implement an experimentation platform that enables the team to conduct online experiments for quick product iterations.
Who we are looking for
- BS/MS degree in Computer Engineering, Computer Science, or a related field.
- Fresh grads are welcome! But having a full-time experience in tech or related industry is a plus.
- Proficiency with at least one of these programming languages: Java, Scala, Python, any other OOP languages, or other functional languages.
- Interested in building and troubleshooting large-scale distributed products.
- Interested in big data technologies such as Hadoop, Hive, Avro, Parquet, Presto, Spark, or Kafka is highly desired.