91 Data Engineering Manager jobs in Singapore

We are seeking a skilled Data Architecture Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing scalable and robust data pipelines and ETL processes to ingest, parse, process, and store structured and unstructured data from various sources.

• Design and develop data architectures to support efficient querying and reporting using data platforms such as Snowflake, Redshift, MySQL, MongoDB, and S3.
• Implement change data capture (CDC) capable of capturing changes made to source data and propagating them downstream to other systems or applications.
• Collaborate with data scientists and business stakeholders to understand their data requirements and ensure data integrity, accuracy, and timeliness.
• Monitor and troubleshoot data pipeline performance to ensure optimal data flow and minimal downtime.

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3-5 years of experience in data engineering or a related field, with a strong background in data architecture and data modeling.
• Proficient in SQL, Python, and/or other programming languages relevant to data engineering.
• Experience with data ingestion, processing, and storage tools and technologies, such as Snowflake, Redshift, MySQL, MongoDB, S3, Airflow, dbt, AWS Glue.
• Strong understanding of data warehousing concepts, ETL processes, and data modeling best practices.

• A fast-paced and dynamic work environment that fosters collaboration and innovation.
• The opportunity to work on cutting-edge data engineering projects and technologies.
• A competitive compensation package that includes benefits and opportunities for professional growth.

• A collaborative and supportive team environment that encourages open communication and knowledge sharing.
• The opportunity to work on diverse and challenging data engineering projects that require creative problem-solving and technical expertise.
• A comprehensive training program that includes workshops, conferences, and online courses to help you stay up-to-date with the latest data engineering trends and technologies.

Job Title: Data Architecture Specialist

I am seeking a talented Data Architecture Specialist to join our team. As a key member of the data team, you will be responsible for designing and developing data architectures that meet the company's business needs.

Key Responsibilities:

• Design and develop data pipelines and systems for data modeling, mining, and production
">

• Develop, construct, test, and maintain data architectures such as databases, data warehouses, and large-scale data processing systems
">

• Make raw data clean and highly available for use in descriptive and predictive modeling
">

• Recommend and implement ways to improve data quality, reliability, flexibility, and efficiency
">

• Ensure data assets and data catalogs are organized and stored in an efficient way
">

Requirements:

• Min 3 years in data architecture, data warehousing, data processing, data modeling, and ETL/ELT with familiarity with real-time streaming solutions
">

• Experience in Kubernetes-based DevOps practices, with experience in container orchestration, CI/CD pipelines, and microservices deployment
">

• Experience in database development (Oracle SQL/PLSQL)
">

• Working experience in AWS cloud environment, familiar with solutions such as EC2, S3, EMR, Redshift, Athena, Kinesis
">

• Programming knowledge in Python, R, SQL for data cleaning, processing, and aggregation
">

• Mandarin speaking required
">

Benefits:

• Hybrid working arrangement
">

• Office at CBD
">

• Variable bonus
">

This is a fantastic opportunity to work on high-impact projects and develop your skills in data architecture and engineering. If you are passionate about data and technology, please apply today!

This role is responsible for collaborating with cross-functional teams to understand requirements, develop strategic solutions that align with business goals, and drive the success of our data and analytics initiatives.

• Design end-to-end data architecture that meets business requirements, leveraging industry best practices and emerging technologies.
• Collaborate with stakeholders to understand data needs and translate them into technical requirements and architecture.
• Evaluate and recommend suitable data platforms, tools, and technologies for data processing, visualization, and advanced analytics.
• Develop and maintain technical documentation, including architecture diagrams, design documents, and data flow diagrams.

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Proven experience as a Solutions Architect, Data Architect, or a similar role, with a focus on data and analytics solutions.
• Strong expertise in data architecture, data modeling, data integration, data lake, and data warehousing concepts.
• Hands-on experience with data analytics platforms, such as Synapse, Databricks, Snowflakes, Denodo, or equivalent.
• Proficiency in cloud platforms and services, such as AWS, Azure, or Google Cloud Platform, and knowledge of cloud-native data technologies.

• Data visualization and reporting tools, such as Power BI, Tableau, QlikView/Qlik Sense or equivalent.
• Database technologies, both relational and NoSQL databases.
• DevOps strategy and automated pipelines (CI/CD).
• Excellent problem-solving and analytical skills, with the ability to translate business requirements into technical solutions.

We are seeking a skilled Software Engineer to join our team. The ideal candidate will have experience with cloud platforms, AI/ML tools, and modern development methodologies.

The Senior Software Engineer will be responsible for designing, developing, and deploying scalable software systems that integrate AI and machine learning. They will also lead and mentor a small team of engineers, fostering a collaborative and high-performance environment.

Key responsibilities include:

• Designing and developing software systems that meet business requirements
• Leading and mentoring a team of engineers
• Participating in architectural decisions
• Ensuring software quality through code reviews, testing, and best practices

To be successful in this role, the candidate should have:

• PhD, Master's, or Bachelor's degree in Computer Science, Engineering, or related field
• 5+ years of engineering experience in a relevant domain
• Experience with cloud platforms (AWS, Azure, GCP, or equivalent)
• Proficiency in programming languages such as Python, Java, C++, or similar
• Proficiency in AI/ML tools and frameworks (e.g., TensorFlow, PyTorch, scikit-learn)

This position offers opportunities for growth and development, as well as a competitive salary and benefits package.

As a Senior Software Engineer, you will have the opportunity to work on challenging projects and collaborate with a talented team of engineers.

We are seeking a highly skilled Data Architect to join our team. As a key member of our data management team, you will be responsible for designing and implementing scalable data architectures that meet the needs of our business.

Senior Data Engineer

As a forward-deployed engineer, you will partner with agencies to solve complex challenges, gather insights, and drive continuous improvement in our product offerings. You will be responsible for:

• Translating data requirements from business users into technical specifications.
• Collaborating with partner agency's IT teams on technology stack, infrastructure, and security alignment.

Key Responsibilities:

1. Architect and build ingestion pipelines to collect, clean, merge, and harmonize data from different source systems.
2. Day-to-day monitoring of databases and ETL systems, e.g., database capacity planning and maintenance, monitoring, and performance tuning; diagnose issues and deploy measures to prevent recurrence; ensure maximum database uptime.
3. Construct, test, and update useful and reusable data models based on data needs of end users.
4. Design and build secure mechanisms for end users and systems to access data in data warehouse.
5. Research, propose, and develop new technologies and processes to improve agency data infrastructure.
6. Collaborate with data stewards to establish and enforce data governance policies, best practices, and procedures.
7. Maintain data catalogue to document data assets, metadata, and lineage.
8. Implement data quality checks and validation processes to ensure data accuracy and consistency.
9. Implement and enforce data security best practices, including access control, encryption, and data masking, to safeguard sensitive data.

Requirements:

Our ideal candidate should possess the following qualifications:

• A Bachelor's Degree, preferably in Computer Science, Software Engineering, Information Technology, or related disciplines.
• Deep understanding of system design, data structure, and algorithms, data modelling, data access, and data storage.
• Demonstrated ability in using cloud technologies such as AWS, Azure, and Google Cloud.
• Experience with Databricks.
• Experience in designing, building, and maintaining batch and real-time data pipelines.
• Experience with orchestration frameworks such as Airflow, Azure Data Factory.
• Proficiency in working with Python, Shell Scripts, and SQL.

Preferred Requirements:

While not mandatory, the following skills would be highly beneficial:

• Familiarity with building and using CI/CD pipelines.
• Familiarity with DevOps tools such as Docker, Git, Terraform.
• Experience with implementing technical processes to enforce data security, data quality, and data governance.
• Familiarity with government systems and government's policies relating to data governance, data management, data infrastructure, and data security.
• Experience in Climate and Weather domains will be an advantage.

Senior Data Architect Position

We are seeking a highly skilled Senior Data Architect to lead our efforts in data engineering and infrastructure. This individual will work closely with cross-functional teams to design, build, and maintain our data systems.

This role combines deep technical expertise with business acumen, ensuring that our data solutions meet the evolving needs of our customers.

The ideal candidate will have experience in designing and implementing large-scale data architectures, as well as a strong understanding of cloud technologies such as AWS, Azure, and Google Cloud.

Key responsibilities include:

• Designing and implementing data ingestion pipelines to collect, clean, and harmonize data from various sources.
• Collaborating with partner IT teams on technology stack, infrastructure, and security alignment.

What We Are Looking For:

• A Bachelor's Degree in Computer Science, Software Engineering, or related field.
• Deep understanding of system design, data structure, and algorithms, data modeling, data access, and data storage.
• Demonstrated ability in using cloud technologies such as AWS, Azure, and Google Cloud.
• Experience with Databricks.
• Experience in designing, building, and maintaining batch and real-time data pipelines.
• Experience with orchestration frameworks such as Airflow, Azure Data Factory.
• Proficiency in working with Python, Shell Scripts, and SQL.

Preferred Requirements:

• Familiarity with building and using CI/CD pipelines.
• Familiarity with DevOps tools such as Docker, Git, Terraform.
• Experience with implementing technical processes to enforce data security, data quality, and data governance.
• Familiarity with government systems and policies relating to data governance, data management, data infrastructure, and data security.
• Experience in Climate and Weather domains is an advantage.

We are an equal opportunity employer committed to fostering an inclusive workplace that values diverse voices and perspectives.

We champion flexible work arrangements and trust you to manage your time to deliver your best.

Our employee benefits are based on a total rewards approach, offering a holistic and market-competitive suite of perks.

We are seeking an experienced Senior Data Architecture Specialist to design and implement scalable data architectures and pipelines.

• Develop data models to support advanced analytics and reporting.
• Collaborate with cross-functional teams to define and deliver data-driven solutions.
• Propose innovative approaches for data storage, processing, and governance.

• Masters degree in Computer Science, Data Engineering, or related fields.
• 8-12 years of experience in data engineering or related roles.
• Experience with distributed data processing frameworks (e.g., Spark, Hadoop, Flink).
• Strong skills in SQL, Python, and cloud-based data platforms (AWS, Azure, GCP).
• Familiarity with containerization and orchestration tools (Docker, Kubernetes).
• Experience with CI/CD and data workflow orchestration (Airflow, Prefect, Dagster).

• A collaborative and dynamic work environment.
• Opportunities for professional growth and development.
• Competitive compensation and benefits package.

• Synthesize complex problems and propose actionable solutions.
• Lead junior consultants and contribute to the organization's long-term data strategy.

We are seeking a Senior Data Platform Solution Architect to develop and maintain Azure data architecture, ensuring compliance with data-related policies and standards.

• Data solutions using Databricks are designed and implemented, including data pipelines, ETL processes, and data lakes. System integration challenges are analyzed, and collaboration with data engineers and IT teams addresses technical issues and supports infrastructure needs.
• Data security and privacy protection measures are implemented, and strategies for data acquisition, archive recovery, and database implementation are developed.
• Data governance teams collaborate to ensure data solutions comply with banking regulations.
• System performance is monitored, issues are troubleshooted, and knowledge of the Azure platform, Databricks, and industry best practices is maintained.