Banner Default Image

Data Engineer

Back to job search

Data Engineer

  • Location:

    Hong Kong

  • Sector:

    LMA Asia Digital & Data Analytics

  • Job type:

    Permanent

  • Salary:

    Negotiable

  • Contact:

    Angel Chan

  • Contact email:

    shazelina.shafei@lmarecruitment.asia

  • Job ref:

    BBBH437603_1707287897

  • Published:

    15 days ago

  • Expiry date:

    2024-02-14

  • Client:

    LMA

Data Engineer

Responsibilities:

  • Migrate data pipelines from Informatica to Databricks, ensuring seamless integration and efficient data processing.
  • Design, develop, and optimize data processing workflows using SQL, PL/SQL, or python.
  • Implement and enforce data governance and security measures to protect sensitive data and ensure compliance.
  • Establish and maintain data lineage documentation to track the origin, transformations, and destinations of data.
  • Collaborate with cross-functional teams to identify data requirements and implement optimal solutions.
  • Monitor and troubleshoot data pipelines to ensure smooth and uninterrupted data flow.
  • Conduct testing and validation of data pipelines to ensure accuracy, completeness, and data quality.
  • Optimize data storage, retrieval, and archival processes in collaboration with database administrators and infrastructure teams.
  • Stay updated with industry trends and advancements in data engineering, big data technologies, and cloud computing.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience in migrating data pipelines from Informatica to Databricks.
  • Strong proficiency in Oracle 12c, ADW, MSSQL, and MYSQL.
  • Proficient in programming languages such as Python, Scala, or SQL for data processing and transformation.
  • Solid understanding of data governance and security principles.
  • Experience in maintaining data lineage documentation.
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.
  • Ability to adapt to changing priorities and work effectively in a fast-paced environment.

Company Reg No.: 201131609D | License No.: 11C4684 | Angel Chan