149 Cloud Data Engineer jobs in Singapore
Cloud Data Engineer
Posted today
Job Viewed
Job Description
- Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake. Integrate Informatica IDMC for metadata management and data cataloging.
- Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
- Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
- Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
- Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
Requirements
- Good experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
- Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
- Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
- Strong knowledge of SQL and NoSQL databases.
- Familiarity with data modeling and schema design.
- AWS certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Data Analytics - Specialty), Databricks certifications, and Informatica certifications are a plus.
Cloud Data Engineer
Posted today
Job Viewed
Job Description
About the role
Join Alphaeus Pte Ltd as a Cloud Data Engineer and play a crucial role in developing and maintaining our cutting-edge cloud-based data infrastructure. As a fulltime employee based in the Central Region, you will be responsible for designing, implementing, and optimizing data pipelines and platforms to support the company's data-driven initiatives.
What you'll be doing
- Design and develop efficient and scalable cloud-based data pipelines and data processing workflows
- Implement and maintain data ingestion, transformation, and storage solutions leveraging cloud technologies
- Optimize data processing and storage for performance, cost-effectiveness, and reliability
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Automate and streamline data operations to improve productivity and reduce manual efforts
- Monitor and troubleshoot data infrastructure issues, ensuring data integrity and availability
- Stay up-to-date with the latest cloud technologies and best practices in data engineering
What we're looking for
- Windows Expertise on AWS: Proven experience in configuring, hardening, and managing Windows Server 2022 (priority), 2019, and 2016 in a cloud-native environment.
- AMI Factory Management: Hands-on experience with automated AMI pipeline management—building, maintaining, and versioning compliant Windows AMIs at scale.
- Security and Compliance Integration: Integration of enterprise observability agents (e.g., CloudWatch, Splunk, DataDog etc), endpoint protection tools, and compliance agents (e.g., Trend Micro) as part of image builds.
- Industry Benchmarking: Familiarity with applying CIS Benchmarks for Windows operating systems and ensuring that AMIs are hardened and validated against such benchmarks.
- MS SQL Standard Builds: Exposure to packaging and maintaining MS SQL Server configurations as part of the standard image builds, ensuring licensing, security, and performance configurations are aligned with best practices.
- Automation & Infrastructure as Code: Strong experience with automation tools git ansible, CloudFormation (important) and PowerShell, AWS SSM, Packer (not important), Terraform (not important), to support AMI lifecycle management.
- Governance & Documentation: Ability to document standard build processes, hardening steps, and compliance checkpoints to support audit and operational readiness.
What we offer
At Alphaeus Pte Ltd, we are committed to providing a rewarding work environment that enables our employees to thrive. We offer competitive compensation, comprehensive health benefits, and opportunities for professional development. Our flexible work arrangements and emphasis on work-life balance ensure that you can achieve your career goals while maintaining a fulfilling personal life.
About us
Alphaeus Pte Ltd is a leading provider of innovative technology solutions in the Information & Communication Technology sector. With a strong focus on cloud-based data and analytics, we help our clients unlock the power of their data to drive business growth and make informed decisions. Our talented team of professionals is dedicated to delivering cutting-edge solutions that redefine the industry standards.
Apply now to join our dynamic team and be a part of our continued success
Cloud Data Engineer
Posted today
Job Viewed
Job Description
- Develop scalable and compliant data engineering solutions for BI and Data Warehouse projects.
- Collaborate with cross-functional teams to build robust data driven products.
- Provide ongoing maintenance and technical support for deployed data engineering systems.
The ideal candidate will have experience in cloud technologies, database design, big data frameworks and tools.
Required Skills and Qualifications- Proficient in general data cleaning and transformation (e.g. SQL, VQL, pandas, R).
- Proficient in building ETL pipelines using various tools and languages.
- Proficient in database design and management.
Good communication skills are required to work closely with stakeholders and team members.
Cloud Data engineer
Posted today
Job Viewed
Job Description
Overview
Cloud Data Engineer (AI & Analytics domain) – Location: Singapore
Job Summary
As a Cloud data engineer, you will design, build, and maintain scalable, secure, and efficient cloud data architectures on platforms like AWS, Azure, or Google Cloud.
Required Skills And Experience
5+ years of Data consulting experience, or other relevant experience in AI & Analytics domain, with a proven track record of building and maintaining client relationships
Collaborate with customers and account partners to identify new Data and AI opportunities, and build proposals.
Organize and lead educational and ideation AI and Generative AI workshops for customers
Understand customer's needs and assess their data maturity
Evaluate and recommend appropriate data pipelines, frameworks, tools and platforms
Lead data feasibility studies and PoC projects to demonstrate the value and viability of Data and AI solutions
Develop end to end AI PoC projects using Python, Flask, FastAPI and Streamlit
Have experience in cloud services of AWS / GCP / Azure to deploy PoCs and pipelines
Have experience with big data frameworks on prem and on cloud
Collaborate with AI architects and engineers to develop Data and AI solutions tailored to the clients' requirements
Lead integration and deployment of data and AI products
Stay updated with the latest advancements in big data and GenAI along with best practices to develop thought leadership and PoV
Work with cross-functional team and partners to develop/ enhance and package AI offerings and assets for customer-facing discussions
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Seniority level
Mid-Senior level
Employment type
Contract
Job function
Information Technology
Industries
IT Services and IT Consulting
#J-18808-Ljbffr
Cloud Data Engineer
Posted today
Job Viewed
Job Description
Responsibilities
Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake. Integrate Informatica IDMC for metadata management and data cataloging.
Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring 1 | P a g e compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance.
Implement automation for routine tasks, such as data ingestion, transformation, and monitoring, using AWS services like AWS Step Functions, AWS Lambda, Databricks Jobs, and Informatica IDMC for workflow automation.
Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations in both AWS and Databricks environments, with metadata management facilitated by Informatica IDMC.
Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver appropriate solutions across AWS, Databricks, and Informatica IDMC.
Identify and resolve data-related issues and provide support to ensure data availability and integrity in both AWS, Databricks, and Informatica IDMC environments.
Optimize AWS, Databricks, and Informatica resource usage to control costs while meeting performance and scalability requirements. Stay up-to-date with AWS, Databricks, Informatica IDMC services, and data engineering best practices to recommend and implement new technologies and techniques.
Qualifications
Bachelor’s or master’s degree in computer science, data engineering, or a related field.
Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC.
Proficiency in programming languages such as Python, Java, or Scala for building data pipelines.
Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
Strong knowledge of SQL and NoSQL databases.
Familiarity with data modeling and schema design.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
AWS certifications (e.g., AWS Certified Data Analytics - Specialty), Databricks certifications, and Informatica certifications are a plus.
Good to have skills: Informatica Cloud, Databricks and AWS.
#J-18808-Ljbffr
AWS Cloud Data Engineer
Posted today
Job Viewed
Job Description
Junior Data Engineer (2 to 4 years experience)
Position Overview
We are seeking a highly skilled AWS Cloud Data Engineer to design, build, and maintain scalable data pipelines and infrastructure on AWS. The ideal candidate will have hands-on experience with cloud-native services, strong data engineering capabilities, and expertise in supporting enterprise-level data ingestion, transformation, and management initiatives.
Key Responsibilities
Design, develop, and maintain data pipelines and ETL/ELT workflows using AWS services.
Build and optimize data lakes and data warehouses on AWS (e.g., S3, Redshift, Snowflake, Databricks).
Implement data ingestion from multiple structured and unstructured sources.
Develop and deploy scalable data processing solutions using AWS Lambda, Glue, EMR, Kinesis, Step Functions, and Terraform.
Ensure data quality, governance, and security in compliance with organizational and regulatory standards.
Collaborate with data scientists, analysts, and business stakeholders to enable analytics and AI/ML initiatives.
Monitor, troubleshoot, and optimize data infrastructure performance and costs.
Required Skills & Qualifications
Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
2 to 4 years of experience in Data Engineering with strong exposure to AWS Cloud.
Strong hands-on expertise with AWS services such as S3, Glue, Redshift, Lambda, IAM, CloudFormation/Terraform.
Experience with data pipeline orchestration (Airflow, Step Functions, or similar).
Proficiency in Python, SQL, and PySpark.
Strong knowledge of data warehousing, data lakes, and data management practices.
Familiarity with Snowflake, Databricks, or similar platforms (preferred).
Strong understanding of DevOps practices, CI/CD pipelines, and cloud infrastructure.
Excellent problem-solving and communication skills.
INFORMATICA Cloud Data Engineer
Posted today
Job Viewed
Job Description
Job Description
- Building data ingestion pipelines to integrate databases and datasets
- Monitoring and alerting across data pipelines in order to make sure that data ingests are reliable and correct
- Interpreting Technical Design documents and implementing them in INFORMATICA IDMC Platform
- Mentoring Junior Data Engineers and guiding them to accomplish the tasks
Requirements
- 5+ Years of IT/Database experience
- 3+ years of experience in a data engineering role with INFORMATICA as a platform(PowerCenter / BDM, Data Engineering DEI)
- 1+ Years of experience in INFORMATICA Cloud (IDMC/IICS) with Cloud Data Integration (CDI) as a tool
- Associate/Practioner Certification in Data Engineering from INFORMATICA is desirable
- Hands-on Experience with relational SQL (such as Oracle, SQL Server and MySQL/PostgreSQL) OR NoSQL databases, such as Hadoop and Hive etc. is essential
- Experience in working with other ETL tools, such as Data Stage, Talend, SSIS or dbt
- Proficiency in writing SQL queries and knowledge of analytical data warehouses such as Hive, Databricks, and Snowflake
- Some working experience with CI/CD automation such as GitHub Actions
- Developing APIs and integrating with 3rd party APIs
- experience in INFORMATICA BDM/DEI will be a distinct advantage
Be The First To Know
About the latest Cloud data engineer Jobs in Singapore !
Senior Cloud Data Engineer
Posted today
Job Viewed
Job Description
Job Summary:
We are seeking a highly skilled Senior Cloud Data Engineer to join our team. The successful candidate will have experience in migrating relational databases to cloud-native data lake solutions, as well as expertise in programming and processing using Python (Pandas, PyArrow) and Apache Spark (PySpark). Strong SQL skills, particularly in query optimization and performance tuning, are also essential.
Key Responsibilities:
- Migrating relational databases to cloud-native data lake solutions
- Programming and processing using Python (Pandas, PyArrow) and Apache Spark (PySpark)
- SQL expertise, including query optimization and performance tuning
- DevOps and infrastructure management using Terraform/CloudFormation and CI/CD pipelines
- Excellent communication and interpersonal skills, with strong analytical and problem-solving abilities
About the Role:
- Strong proficiency in Python coding, including use of Pandas, PyArrow, and PySpark
- This is a 5-month renewable contract
About Us:
Our organization is a leading provider of IT consulting services, working with top clients across various industries.
INFORMATICA Cloud Data Engineer
Posted today
Job Viewed
Job Description
Job Description
Building data ingestion pipelines to integrate databases and datasets
Monitoring and alerting across data pipelines in order to make sure that data ingests are reliable and correct
Interpreting Technical Design documents and implementing them in INFORMATICA IDMC Platform
Mentoring Junior Data Engineers and guiding them to accomplish the tasks
Requirements
5+ Years of IT/Database experience
3+ years of experience in a data engineering role with INFORMATICA as a platform(PowerCenter / BDM, Data Engineering DEI)
1+ Years of experience in INFORMATICA Cloud (IDMC/IICS) with Cloud Data Integration (CDI) as a tool
Associate/Practioner Certification in Data Engineering from INFORMATICA is desirable
Hands-on Experience with relational SQL (such as Oracle, SQL Server and MySQL/PostgreSQL) OR NoSQL databases, such as Hadoop and Hive etc. is essential
Experience in working with other ETL tools, such as Data Stage, Talend, SSIS or dbt
Proficiency in writing SQL queries and knowledge of analytical data warehouses such as Hive, Databricks, and Snowflake
Some working experience with CI/CD automation such as GitHub Actions
Developing APIs and integrating with 3rd party APIs
experience in INFORMATICA BDM/DEI will be a distinct advantage
#J-18808-Ljbffr
INFORMATICA Cloud Data Engineer
Posted 4 days ago
Job Viewed
Job Description
Job Description
- Building data ingestion pipelines to integrate databases and datasets
- Monitoring and alerting across data pipelines in order to make sure that data ingests are reliable and correct
- Interpreting Technical Design documents and implementing them in INFORMATICA IDMC Platform
- Mentoring Junior Data Engineers and guiding them to accomplish the tasks
Requirements
- 5+ Years of IT/Database experience
- 3+ years of experience in a data engineering role with INFORMATICA as a platform(PowerCenter / BDM, Data Engineering DEI)
- 1+ Years of experience in INFORMATICA Cloud (IDMC/IICS) with Cloud Data Integration (CDI) as a tool
- Associate/Practioner Certification in Data Engineering from INFORMATICA is desirable
- Hands-on Experience with relational SQL (such as Oracle, SQL Server and MySQL/PostgreSQL) OR NoSQL databases, such as Hadoop and Hive etc. is essential
- Experience in working with other ETL tools, such as Data Stage, Talend, SSIS or dbt
- Proficiency in writing SQL queries and knowledge of analytical data warehouses such as Hive, Databricks, and Snowflake
- Some working experience with CI/CD automation such as GitHub Actions
- Developing APIs and integrating with 3rd party APIs
- experience in INFORMATICA BDM/DEI will be a distinct advantage