Senior Data Engineer

VALIDUS VIỆT NAM

Lượt xem: 201

Ngày cập nhật: 24-03-2024

Địa điểm: Hồ Chí Minh

Ngành nghề: IT - Phần cứng/ Mạng IT - Phần mềm

Vị trí: Nhân viên

Mức lương: Cạnh tranh

Trình độ: Đại học

Kinh nghiệm: Trên 5 Năm

Đang tải ...

Mô tả công việc

  • Design, develop, and maintain scalable and robust data pipelines and ETL processes to ingest, parse, process, and store structured and unstructured data from various sources
  • Implement change data capture (CDC) capable of capturing changes made to source data and propagating them downstream to other systems or applications.
  • Develop and maintain data architecture and data models to support efficient querying and reporting, using data platforms such as Snowflake/Redshift, MySQL, MongoDB, S3.
  • Utilize dbt (Data Build Tool) for transforming and modeling data in the warehouse.
  • Collaborate with data analysts, data scientists, and business stakeholders such as CEO, COO, lending and Neobanking product teams, sales, risk, investor relations, and finance to understand their data requirements and ensure data integrity, accuracy, and timeliness.
  • Collaborate with the technology team regarding data architecture and source databases, which are managed by the tech team.
  • Collaborate with the data scientists to develop and maintain BI dashboards and visualizations using tools like Power BI to provide actionable insights for business decision-makers.
  • Monitor and troubleshoot data pipeline performance, ensuring optimal data flow and minimal downtime.
  • Support ad hoc data extraction, processing and analysis with scripting while working towards automation in the future
  • Implement data security best practices to ensure data privacy and compliance with relevant regulations.
  • Continuously research and adopt new technologies, tools, and best practices to improve data engineering processes and infrastructure.
  • Mentor and support junior data engineers, fostering a culture of learning and collaboration within the team.

Yêu cầu công việc

  • Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.
  • At least 5 years of experience in data engineering or a related field, with a strong background in data architecture and data modelling
  • Background in software engineering and experience with CI/CD, DevOps, K8s is a strong plus.
  • Proficient in SQL, Python, and/or other programming languages relevant to data engineering.
  • Experience with data ingestion, processing, and storage tools and technologies, such as Snowflake, Redshift, MySQL, MongoDB, S3, Appflow/Fivetran, Airflow/Dagster, Kafka, dbt, AWS Glue.
  • Strong understanding of data warehousing concepts, ETL processes, and data modeling best practices.
  • Experience using one or more cloud data services: AWS, Azure, Google cloud
  • Experience with Optical Character Recognition (OCR) for data extraction is a strong plus.
  • Familiarity with BI tools and platforms, such as Power BI, Tableau, or Looker.
  • Familiarity with one of the data management tools such as Atlan, Collibra is a plus.
  • Ability to work independently and collaboratively in a fast-paced, dynamic/somewhat unstructured environment.
  • Strong emphasis towards delivering business outcomes and collaborating with business stakeholders to ensure the data solutions are fit for the business use cases at hand.
  • Experience mentoring junior team members is a plus.

If you are a skilled and motivated/tenacious data engineer looking to make a meaningful impact on a growing company, we invite you to join our team at Validus.

Quyền lợi công việc

  • Chế độ bảo hiểm
  • Du Lịch
  • Chế độ thưởng
  • Chăm sóc sức khỏe
  • Đào tạo
  • Tăng lương
Đang tải ...

Hạn nộp: 23-04-2024

Bấm để nộp hồ sơ ứng tuyển miễn phí

Nộp hồ sơ

Đang tải ...
Đang tải ...

VIỆC LÀM TƯƠNG TỰ

Đang tải ...
Đang tải ...