712 Data Engineer jobs in Singapore

Rapsodo is a Sports Technology company with offices in the USA, Singapore, Turkey & Japan. We develop sports analytics products that are data-driven, portable and easy-to-use to empower athletes at all skill levels to analyse and improve their performance. From Major League Baseball star pitchers to Golf tour players, athletes use Rapsodo technology to up their game across the world. Trusted by coaches and players from youths to professionals, Rapsodo provides real-time insights for all-time performance.

We are innovative, focused, and rapidly growing. We are continuously looking for team players who will stop at nothing to deliver state-of-the-art solutions as part of Team Rapsodo.

If you have a passion for sports analytics , love working with Python, R, SQL , and enjoy building data pipelines and visualizations in Tableau, Power BI, and Matplotlib , this is your opportunity to play a pivotal role in shaping the future of data-driven sports performance.

• Develop scalable ETL pipelines to process performance and tracking data , ensuring seamless flow from data capture to analysis.
• Analyze and optimize sports data , translating raw sensor readings into meaningful performance metrics for athletes and coaches.
• Leverage Python, R, and SQL to build advanced analytics models, unlocking deeper insights into player performance.
• Create intuitive dashboards and reports using Tableau, Power BI, and Matplotlib , enabling users to visualize and interpret data effectively.
• Ensure data accuracy, consistency, and accessibility , collaborating with sports scientists, product teams, and software engineers.
• Continuously improve data workflows to enhance efficiency and support real-time analytics for Rapsodo’s cutting-edge sports products.

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Mathematics, Statistics, or a related field (or equivalent hands-on experience ).
• 3-5 years of experience in data engineering, analytics, or a related role.
• Strong proficiency in Python, R, and SQL for data transformation and statistical analysis.
• Experience working with sensor-based data or time-series data (preferred ).
• Hands-on expertise in Tableau, Power BI, and Matplotlib for creating insightful visualizations.
• A passion for sports analytics and the ability to bridge the gap between raw data and real-world performance insights .
• Strong problem-solving skills and the ability to work independently in a fast-paced environment.
• Excellent communication skills , able to collaborate effectively with both technical and non-technical stakeholders.

At Rapsodo, you'll help to drive innovation in sports analytics .

You’ll work with state-of-the-art tracking technology to develop high-performance data systems that transform complex data into actionable insights for athletes and coaches.

You’ll have the opportunity to collaborate with athletes, engineers, and product teams, pushing the boundaries of real-time analytics .

If you're passionate about solving complex data challenges , optimizing large-scale data workflows , and shaping the future of sports technology , we’d love to hear from you!

Join to apply for the Data Engineer role at Internal Security Department

What The Role Is

ISD confronts and addresses threats to Singapore’s internal security and stability. For over 70 years, ISD and its predecessor organisations have played a central role in countering threats such as those posed by foreign subversive elements, spies, racial and religious extremists, and terrorists. A fulfilling and rewarding career awaits those who want to join ISD’s critical mission of keeping Singapore safe, secure, and sovereign for all Singaporeans.

What You Will Be Working On

• Design, build, maintain, and optimize data pipeline architecture
• Collaborate with Data Scientists and Analysts to optimise extraction, transformation, and loading of data from various sources using SQL and Big Data technologies
• Evaluate Data Analytics technologies to recommend tools and frameworks for data processing and analysis

What We Are Looking For

• Experience with scripting languages like Python, SQL, Scala, Spark, or PowerShell is preferred
• Applicants with no experience may apply
• Good interpersonal and communication skills
• Strong analytical skills and problem-solving ability
• Ability to work independently and in a team
• Only Singaporeans need apply

We wish to inform that only shortlisted candidates will be notified.

The Customer Lifecycle Management (CLM) team at StarHub is dedicated to understanding, enhancing, and optimizing the customer journey. From acquisition to retention, the CLM team employs data-driven strategies to provide unparalleled customer experiences. Through a combination of data science, business intelligence, customer insights, NPS, and digital analytics, the CLM team ensures that StarHub's offerings are aligned with customer needs, leading to increased loyalty, satisfaction, and growth.

The Data Engineer plays a crucial role in the CLM team by designing, implementing, and maintaining the data infrastructure that supports the team's analytics and data science initiatives. This position is responsible for developing and optimizing data pipelines, ensuring data quality and accessibility, and collaborating with data scientists and analysts to enable efficient data-driven decision-making. The Data Engineer will work on integrating data from various sources, implementing data governance practices, and creating scalable solutions that support the CLM team's objectives in enhancing customer experiences and driving business growth.

• Data Pipeline Development : Design, implement, and maintain efficient ETL (Extract, Transform, Load) processes to integrate data from various sources. Optimize existing data pipelines for improved performance and scalability.
• Data Warehouse Management: Develop and maintain the data warehouse architecture, ensuring it meets the needs of the CLM team. Implement data modeling techniques to optimize data storage and retrieval.
• Data Quality Assurance: Implement data quality checks and monitoring systems to ensure the accuracy and reliability of data used in analytics and reporting. Develop and maintain data documentation and metadata.
• Big Data Technologies: Utilize big data technologies (e.g., Hadoop, Spark) to process and analyze large volumes of customer data efficiently. Implement solutions for real-time data processing when required.
• Data Governance: Collaborate with relevant stakeholders to implement data governance policies and procedures. Ensure compliance with data privacy regulations and internal data management standards.
• Infrastructure Optimization: Continuously assess and optimize the data infrastructure to improve performance, reduce costs, and enhance scalability. Implement automation solutions to streamline data processes.

Education Level:

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field. Master's degree in a relevant field is preferred.
• Required Experience and Knowledge
• 3-5 years of experience in data engineering or a related field.
• Strong knowledge of data warehouse concepts, ETL processes, and data modeling techniques.
• Experience with cloud-based data platforms (e.g., AWS, SnowFlake).
• Proficiency in SQL and experience with NoSQL databases.
• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Knowledge of data governance principles and data privacy regulations.

Job-Specific Technical Skills:

• Proficiency in Python or Scala for data processing and automation.
• Experience with ETL tools (e.g., Apache NiFi, Talend, Informatica).
• Knowledge of data visualization tools (e.g., Tableau, PowerBI) to support data quality checks and pipeline monitoring.
• Familiarity with version control systems (e.g., Git) and CI/CD practices.
• Experience with container technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes).
• Understanding of data security best practices and implementation.

Behavioural Skills:

• Strong problem-solving and analytical skills.
• Excellent communication abilities to collaborate with technical and non-technical team members.
• Proactive approach to identifying and resolving data-related issues.
• Ability to manage multiple projects and priorities effectively.
• Detail-oriented with a focus on data quality and system reliability.
• Adaptability to work with evolving technologies and changing business requirements.
• Strong teamwork skills and ability to work in a collaborative environment.

About PatSnap

Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable insights that increase productivity for IP tasks by 75% and reduce R&D wastage by 25%. Over 15,000 companies trust Patsnap to innovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, and Wilson Sonsini.

• Manage daily operations of patent data and related data, including integration, parsing, storage, and backup, ensuring data security, stability, and availability;
• Analyze and understand new data requirements, design data processing solutions, write relevant documentation, and implement code;
• Monitor data quality, design and implement targeted optimization solutions, and continuously improve data integrity and accuracy;
• Optimize data processing frameworks and performance, enhancing the efficiency of system data handling to support rapid iteration of product data;
• Work closely with data architects, participate in architecture upgrades and updates, and enhance system scalability and stability.

• Bachelor’s degree or above in computer science, data engineering, software engineering, or related fields; at least 3 years of experience in data development;
• Proficiency in Java or Python with a solid programming foundation;
• Familiarity with basic components of big data processing, such as Flink and Spark, with experience in performance optimization preferred;
• Familiarity with Linux systems and common operations;
• Strong sense of responsibility and proactive learning ability, able to adapt flexibly in a fast-paced environment;
• Clear thinking with excellent communication skills and team spirit, able to collaborate effectively with team members from diverse cultural backgrounds;
• Basic understanding of data privacy and compliance, capable of working in a regulatory environment.

Why Join Us

Technical Growth: Directly participate in large-scale data processing and optimization projects, gaining practical technical experience.

Systematic Training: Engage in architecture optimization under the guidance of senior data architects, enhancing data processing and system design capabilities.

Diverse Team: Rich opportunities for cross-departmental and multinational collaboration, helping you rapidly grow into a full-stack data engineer.

Career Development: Clear career development paths and ample space for growth.

Bounteous is a premier end-to-end digital transformation consultancy dedicated to partnering with ambitious brands to create digital solutions for today’s complex challenges and tomorrow’s opportunities. With uncompromising standards for technical and domain expertise, we deliver innovative and strategic solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing.`

One of our key Financial Services clients is looking for a Lead Data Engineer for a senior position based in Singapore.

Job Description

We seek individuals with highly developed conceptual, strategic, and analytical skills, capable of striking a balance between visionary thinking and practical solutions. The ability to comprehend, inspire, and mobilize others is crucial. A business-oriented mindset coupled with effective storytelling will drive your success. We are looking for self-starters ready to take on responsibilities with enthusiasm.

Your Role

As a Lead Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solution.

Your main responsibilities will include:

• Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.
• Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
• Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
• Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
• Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques.
• Optimize data engineering workflows for containerized deployment and efficient resource utilization.
• Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability.
• Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements.
• Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure.
• Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference.
• Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps.
• Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank.

Requirements

• Bachelor’s degree in computer science, Data Engineering, Information Technology, or a related field.
• At least 10 years of experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments.
• Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Ranger, etc)
• Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes.
• Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java.
• Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
• Experience with Grafana, Prometheus, Splunk will be an added benefit
• Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges.
• Excellent collaboration and communication skills to work effectively with cross-functional teams.
• Ability to manage multiple priorities, meet deadlines, and deliver high-quality results in a fast-paced environment.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services is a plus.

What's on Offer

Bounteous brings together 5000+ employees spanning North America, APAC, and EMEA, and partnerships with leading technology providers. Through advanced digital engineering, technology solutions, and data-driven digital experiences, we create exceptional and efficient business impact and help our clients win.

Bounteous is focused on promoting an inclusive environment and is proud to be an equal opportunity employer. We celebrate the different viewpoints and experiences our diverse group of team members bring to Bounteous. Bounteous does not discriminate on the basis of race, religion, colour, gender identity, sexual orientation, age, physical or mental disability, national origin, or any other status protected under state, or local law.

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries IT Services and IT Consulting and Financial Services

Referrals increase your chances of interviewing at Bounteous by 2x

Downtown Core, Central Singapore Community Development Council, Singapore 1 week ago

Queenstown, Central Singapore Community Development Council, Singapore 5 months ago

South East Community Development Council, Singapore 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Join to apply for the Data Engineer role at Bitdeer (NASDAQ: BTDR)

Get AI-powered advice on this job and more exclusive features.

About Bitdeer:
Bitdeer Technologies Group (NASDAQ: BTDR) is a leader in the blockchain and high-performance computing industry. It is one of the world's largest holders of proprietary hash rate and suppliers of hash rate. Bitdeer is committed to providing comprehensive computing solutions for its customers.

The company was founded by Jihan Wu, an early advocate and pioneer in cryptocurrency who cofounded multiple leading companies serving the blockchain economy. Headquartered in Singapore, Bitdeer has deployed mining datacenters in the United States, Norway, and Bhutan. It offers specialized mining infrastructure, high-quality hash rate sharing products, and reliable hosting services to global users. The company also offers advanced cloud capabilities for customers with high demands for artificial intelligence. Dedication, authenticity, and trustworthiness are foundational to our mission of becoming the world's most reliable provider of full-spectrum blockchain and high-performance computing solutions. We welcome global talent to join us in shaping the future.

We are seeking an experienced Data Engineer to join our Data Platform team with a focus on improving and optimizing our existing data infrastructure. The ideal candidate will have deep expertise in data management, cloud-based big data services, and real-time data processing, collaborating closely with cross-functional teams to enhance scalability, performance, and reliability.

• Optimize and improve existing data pipelines and workflows to enhance performance, scalability, and reliability.
• Collaborate with the IT team to design and enhance cloud infrastructure, ensuring alignment with business and technical requirements.
• Demonstrate a deep understanding of data management principles to optimize data frameworks, ensuring efficient data storage, retrieval, and processing.
• Act as the service owner for cloud big data services (e.g., AWS EMR with Spark) and orchestration tools (e.g., Apache Airflow), driving operational excellence and reliability.
• Design, implement, and maintain robust data pipelines and workflows to support analytics, reporting, and machine learning use cases.
• Develop and optimize solutions for real-time data processing using technologies such as Apache Flink and Kafka.
• Monitor and troubleshoot data systems, identifying opportunities for automation and performance improvements.

Stay updated on emerging data technologies and best practices to drive continuous improvement in data infrastructure.

• Mid-Senior level

• Full-time

• Information Technology

• Software Development

Rapsodo is a Sports Technology company with offices in the USA, Singapore, Turkey & Japan. We develop sports analytics products that are data-driven, portable and easy-to-use to empower athletes at all skill levels to analyse and improve their performance. From Major League Baseball star pitchers to Golf tour players, athletes use Rapsodo technology to up their game across the world. Trusted by coaches and players from youths to professionals, Rapsodo provides real-time insights for all-time performance.

We are innovative, focused, and rapidly growing. We are continuously looking for team players who will stop at nothing to deliver state-of-the-art solutions as part of Team Rapsodo.

If you have a passion for sports analytics , love working with Python, R, SQL , and enjoy building data pipelines and visualizations in Tableau, Power BI, and Matplotlib , this is your opportunity to play a pivotal role in shaping the future of data-driven sports performance.

• Develop scalable ETL pipelines to process performance and tracking data , ensuring seamless flow from data capture to analysis.
• Analyze and optimize sports data , translating raw sensor readings into meaningful performance metrics for athletes and coaches.
• Leverage Python, R, and SQL to build advanced analytics models, unlocking deeper insights into player performance.
• Create intuitive dashboards and reports using Tableau, Power BI, and Matplotlib , enabling users to visualize and interpret data effectively.
• Ensure data accuracy, consistency, and accessibility , collaborating with sports scientists, product teams, and software engineers.
• Continuously improve data workflows to enhance efficiency and support real-time analytics for Rapsodo’s cutting-edge sports products.

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Mathematics, Statistics, or a related field (or equivalent hands-on experience ).
• 3-5 years of experience in data engineering, analytics, or a related role.
• Strong proficiency in Python, R, and SQL for data transformation and statistical analysis.
• Experience working with sensor-based data or time-series data (preferred ).
• Hands-on expertise in Tableau, Power BI, and Matplotlib for creating insightful visualizations.
• A passion for sports analytics and the ability to bridge the gap between raw data and real-world performance insights .
• Strong problem-solving skills and the ability to work independently in a fast-paced environment.
• Excellent communication skills , able to collaborate effectively with both technical and non-technical stakeholders.

At Rapsodo, you'll help to drive innovation in sports analytics . You’ll work with state-of-the-art tracking technology to develop high-performance data systems that transform complex data into actionable insights for athletes and coaches. You’ll have the opportunity to collaborate with athletes, engineers, and product teams, pushing the boundaries of real-time analytics .

If you're passionate about solving complex data challenges , optimizing large-scale data workflows , and shaping the future of sports technology , we’d love to hear from you!

About Klook

We are Asia’s leading platform for experiences and travel services, and we believe that we can help bring the world closer together through experiences .

Founded in 2014 by 3 avid travelers, Ethan Lin, Eric Gnock Fah and Bernie Xiong, Klook inspires and enables more moments of joy for travelers with over half a million curated quality experiences ranging from the biggest attractions to paragliding adventures, iconic museums to rich cultural tours, and other convenient local travel services across 2,700 destinations around the world.

Do you share our belief in the wonders of travel? Our international community of over 1,800 employees, based in 30+ locations, certainly do! Global citizens ourselves, Klookers are not only curating memorable experiences for others but also co-creating our world of joy within Klook.

We work hard and play hard, upkeeping our high-performing culture as we are guided daily by our 6 core values:

• Customer First

• Push Boundaries

• Critical Thinking

• Build for Scale

• Less is More

• Win as One

We never settle, and together, we believe in achieving greater heights and realizing endless possibilities ahead of us in the dynamic new era of travel. Care to be a part of this revolution? Join us!

About the Role:

We’re seeking a skilled Data Engineer to join our team and own the end-to-end data pipeline, from ingestion to downstream delivery. You’ll manage marketing data (i.e.g, Facebook, Google, AppsFlyer etc), optimize internal data flows, and support a scalable data subscription service — all while ensuring cost efficiency and reliability in our data warehouse.

What you/ll do:

• Data Ingestion: Build and maintain pipelines for marketing platforms (Facebook, Google, AppsFlyer).
• Data Distribution: Manage subscription services and exports for downstream systems/users.
• Cost Optimization: Monitor and reduce data warehouse costs (e.g., BigQuery).
• dbt Ecosystem: Develop and maintain dbt models, ensuring CI/CD best practices.
• Observability: Implement monitoring for data quality, pipeline performance, and SLA adherence.
• Collaboration: Work with analytics engineers, marketers, and stakeholders to align data solutions with business needs.

What you’ll need::

• 3+ years in data engineering, with expertise in SQL, Spark, Python, and cloud data platforms (GCP/AWS/Azure). - Hands-on experience with dbt (modeling, testing, CI/CD).
• Experience with data orchestration tools (Airflow, Dagster).
• Familiarity with marketing APIs (Meta, Google Ads, AppsFlyer) and ETL/ELT tools.
• Knowledge of cost optimization strategies for data warehouses.
• Strong problem-solving skills and a focus on scalable, maintainable solutions.
• Understanding of data governance and metadata management.

Why Join?

• Impactful role with ownership over critical data infrastructure.
• Collaborative team driving data-driven decision-making.
• Opportunities to innovate and optimize at scale.

Klook is proud to be an equal opportunity employer. We hire talented and passionate people of all backgrounds. We believe that a joyful workplace is an inclusive workplace, one where employees from all walks of life have an equal opportunity to thrive. We’re dedicated to creating a welcoming and supportive culture where everyone belongs.

Klook does not accept unsolicited resumes from any temporary staffing agency, placement service or professional recruiter (“Agency”). Klook will not be responsible for, and will not pay, any fees, commissions or other payments related to such unsolicited resumes.

An Agency must obtain advance written approval from Klook’s Talent Acquisition Team to submit resumes, and then only in conjunction with a valid fully-executed agreement for service and in response to a specific job opening for which the Agency has been requested to submit resumes for. Klook will not be responsible for, and will not pay, any fees, commissions or other payments to any Agency that does not have such agreement in place or does not comply with the foregoing.

Join to apply for the Data Engineer role at Randstad Singapore .

This range is provided by Randstad Singapore. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Direct message the job poster from Randstad Singapore

About the company

I am currently working with a software consultancy firm that provides premium software development and strategy expertise to a wide spectrum of clients. Projects include Gaming, Gambling, Blockchain, and Government Projects.

Salary structure: Base + AWS + variable bonus. 2 rounds of interviews. Hybrid working arrangement. Office located at CBD.

• Develop, construct, test, and maintain data architectures such as databases, data warehouses, and large-scale data processing systems.
• Design and develop data pipelines/systems for data modeling, mining, and production.
• Clean raw data and make it highly available for descriptive and predictive modeling.
• Recommend and implement improvements to data quality, reliability, flexibility, and efficiency.
• Organize and store data assets and catalogs efficiently.
• Perform PL/SQL and SQL tuning and optimization.

• Minimum 3 years of experience in data architecture, warehousing, processing, modeling, and ETL/ELT; familiarity with real-time streaming solutions.
• Experience with Kubernetes-based DevOps practices, including container orchestration, CI/CD pipelines, and microservices deployment.
• Experience working in AWS cloud environment, familiar with EC2, S3, EMR, Redshift, Athena, Kinesis.
• Programming skills in Python, R, SQL for data cleaning, processing, and aggregation.
• Mandarin speaking required to liaise with Chinese counterparts.

To apply online, please use the 'apply' function. Alternatively, contact Stella at 96554170. (EA: 94C3609 / R1875382)

• Entry level

• Full-time

• Information Technology

• Data Infrastructure and Analytics

Referrals can increase your chances of interviewing at Randstad Singapore by 2x.

Get notified about new Data Engineer jobs in Singapore, Singapore .