Job title: Sr. Data Engineer
Job type: Permanent
Emp type: Full-time
Industry: Health Care
Expertise: IT & Telecoms
Salary type: Monthly
Location: Taguig City
Job published: 2021-02-18
Job ID: 33013

Job Description

KEY RESPONSIBILITIES:

  • You will act as a link between Technology and Data Analytics Team by translating analytical requirements into secured and performance technical solutions
  • You will Build, maintain and scale efficient data infrastructure / EDW, ETL and reporting pipelines
  • You will develop and maintain the data platform, business intelligence and experimentation tools
  • You will lead the management of data collection, organize the models, and forecast future needs
  • You will automate repeatable tasks and reports generation
  • You will help acquire, build, maintain, filter, and “clean” data, specifically related to healthcare products data from various systems and sources

 

QUALIFICATIONS & REQUIREMENTS:

  • +3 years of experience using Python (Python, Pandas, Numpy, Jupyter, Airflow, Celery, etc.)
  • +3 years of experience using and managing MySQL solutions including performance tuning
  • Experience building data pipelines in cloud environments (GCP, AWS, Azure)
  • Experience in integrating 3rd party REST APIs in an efficient manner
  • Experience combining data from various sources (S3, Database, API, Pub/Sub) and formats (SQL, Excel, CSV, JSON, Parquet, etc.)
  • Experience working with CI/CD
  • Experience using containers (Docker, k8s)
  • Experience using serverless infrastructure (SQS, Pub/Sub, lambda, cloud functions, etc.)
  • Nice to have: Apache NiFi, ELK, BigQuery, Apache Kafka