Lowongan Kerja 2024 : Data Engineer
Company: Dana
Job description: DANA Indonesia is currently looking for a skilled and highly motivated Senior Data Engineer to join our team in Jakarta.This senior figure shall drive company initiatives in building tools, infrastructure, frameworks, and services to ensure data availability for operational needs and analytical use cases.What you will be working on:1. Designing, building, and maintaining highly available and scalable data infrastructure on the Cloud
2. Designing, developing, and maintaining reliable data ingestion and transformation pipelines using modern workflow orchestrator
3. Designing, developing, and maintaining robust code repository and reliable CI/CD pipelines
4. Designing, developing, and maintaining software packages that abstract out the repetitive procedures for extracting, loading, and transforming raw data into valuable cleaned data
5. Collaborating with Data Analysts, Data Scientists, ML Engineers, Software Engineers, Product Managers, and Business Stakeholders of varying functions to ensure the veracity and the timeliness of the data processed
6. Publishing high-quality technical documentation in company’s internal Wiki and conducting regular knowledge sharing, hands-on training, and mentoring for the less experienced team members
7. Being the VP’s and Manager’s technical counsellor/researcher in designing a future-ready data infrastructureWho you are:1. You have 5+ years of Data Engineering experience, or equivalent experience of handling 500+ daily data pipelines in Terabytes of scale
2. You enjoy working at the intersection of Data Engineering and DevOps
3. You have hands-on experience in managing Kubernetes cluster on the Cloud
4. You are adept at setting up data pipeline CI/CD along with its tests using tools such as Jenkins, Gitlab CI, or equivalent
5. You are fluent in Python, SQL, and Bash scripting for building data infrastructure and for developing data ingestion and transformation pipelines — fluency in Java/Go/Rust is a plus
6. You know how to work with modern workflow orchestrators — Airflow is a must
7. You are skillful at developing abstraction layer on top of workflow orchestrator to enable data transformation at scale
8. You are familiar with various flavour of RDBMS and Columnar Query Engines — familiarity with NoSQL is a plus
9. You know how to work with Apache Spark for both batch and stream data processing — familiarity with Apache Flink or Beam is a plus
10. You are naturally inclined into optimising complex systems, both performance-wise and cost-wise
Expected salary:
Location: Jakarta Selatan
Job date: Mon, 12 Aug 2024 22:06:41 GMT
Kirim CV Sekarang!
