Cloud Data Engineer

Dempsey Resource Management Inc.

£779-909[月薪]
现场办公 - 奎松市3-5年工作经验本科全职
分享

职位描述

职位描述

  • Design, build, and maintain cloud-based data pipelines and workflows that support analytics and operational systems.
  • Integrate data from various sources using APIs and cloud services.
  • Develop clean, efficient, and test-driven code in Python for data ingestion and processing.
  • Optimize data storage and retrieval using big data formats like Apache Parquet and ORC.
  • Implement robust data models, including relational, dimensional, and NoSQL models.
  • Collaborate with cross-functional teams to gather and refine requirements and deliver high-quality solutions.
  • Deploy infrastructure using Infrastructure as Code (IaC) tools such as AWS

职位要求

  1. At least 3 years in a data engineering role working on data integration, processing, and transformation use cases with open-source languages (i.e. Python) and cloud technologies.
  2. With Strong programming skills in Python specifically for API integration and data libraries,with emphasis on quality and test-driven development.
  3. Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies.
  4. Demonstrated proficiency with SQL
  5. Experience with data modeling:
  • Relational modeling
  • Dimensional modeling
  • NoSQL modeling
  1. Working knowledge of IaC on AWS (CloudFormation or CDK)
  2. Working knowledge of AWS Services:
  • Glue, IAM, Lambda, DynamoDb, Step Functions, S3,CloudFormation or CDK
  • Must be willing to work on a hybrid setup, with onsite reporting to Quezon City.
  • Must be available to start by June 1, 2025.
  • Engagement is project-based for 6 months, with a possibility of extension.
  • With experience in Athena, Kinesis, MSK, MWAA, SQS
  1. Experience with orchestration of data flows/pipelines: Apache Airflow or Dagster
  • Experience with data streaming (Kinesis, Kafka)
  • Experience with Apache Spark
  • Client-facing experience, multi-cultural team experience, technical leadership, team leadership
AthenaKinesisMSKSQL
Preview

Maria Palma

Talent Acquisition ManagerDempsey Resource Management Inc.

今日回复 7 次

工作地址

San jose st. St. Group, San Jose, 13 Payatas B, Quezon City, Metro Manila, Philippines

发布于 13 May 2025

举报

Bossjob安全提醒

如果该职位要求您在海外工作,请保持警惕,谨防欺诈。

如果你在求职过程中遇到有以下行为的雇主, 请立即举报

  • 扣留您的身份证,
  • 要求您提供担保或收取财产,
  • 迫使你投资或筹集资金,
  • 收集非法利益,
  • 或其他非法情况。