1,034 Data Engineer jobs in Singapore

Big Data Engineer

Singapore, Singapore $80000 - $120000 Y UNISON Group

Posted today

Job Viewed

Tap Again To Close

Job Description

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. Candidate will also be integrating data sets to provide seamless data access to users.

SKILLS SET AND TRACK RECORD

  • Good understanding and completion of projects using waterfall/Agile methodology.
  • Analytical, conceptualisation and problem-solving skills.
  • Good understanding of analytics and data warehouse implementations
  • Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica
  • Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage
  • Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred
  • Track record in implementing systems using Cloudera Data Platform will be an added advantage.
  • Motivated and self-driven, with ability to learn new concepts and tools in a short period of time
  • Passion for automation, standardization, and best practices
  • Good presentation skills are preferred

The developer is responsible to:

  • Analyse the Client data needs and document the requirements.
  • Refine data collection/consumption by migrating data collection to more efficient channels
  • Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
  • Develop test plan and scripts for system testing, support user acceptance testing.
  • Work with the Client technical teams to ensure smooth deployment and adoption of new solution.
  • Ensure the smooth operations and service level of IT solutions.
  • Support production issues
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $80000 - $120000 Y TikTok Pte. Ltd.

Posted today

Job Viewed

Tap Again To Close

Job Description

Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa. About the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users.

We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.

  • Design and implement a reasonable offline data architecture for large-scale recommendation systems
  • Design and implement flexible, scalable, stable and high-performance storage and computing systems
  • Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
  • Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems
  • Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
  • Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
  • Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

Minimum Qualifications

  • Bachelor's degree or above, majoring in Computer Science, or related fields, with at least 1 year of experience
  • Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
  • Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang
  • Effective communication skills and a sense of ownership and drive
  • Experience of Peta Byte level data processing is a plus
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $120000 - $180000 Y ARYAN SOLUTIONS PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Experience

  • Hands-on Big Data experience using common open-source components (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka).

  • Experience in stakeholder management in heterogeneous business/technology organizations.

  • Experience in banking or financial business, with handling sensitive data across regions.

  • Experience in large data migration projects with on-prem Data Lakes.

  • Hands-on experience in integrating Data Science Workbench platforms (e.g., KNIME, Cloudera, Dataiku).

  • Track record in Agile project management and methods (e.g., Scrum, SAFe).

Skills

  • Knowledge of reference architectures, especially concerning integrated, data-driven landscapes and solutions.

  • Expert SQL skills, preferably in mixed environments (i.e., classic DWH and distributed).

  • Working automation and troubleshooting experience in Python using Jupyter Notebooks or common IDEs.

  • Data preparation for reporting/analytics and visualization tools (e.g., Tableau, Power BI or Python-based).

  • Applying a data quality framework within the architecture.

Role description

  • Datasets and data pipelines preparation, support for Business, data troubleshooting.

  • Closely collaborate with the Data & Analytics Program Management and stakeholders to co-design Enterprise Data Strategy and Common Data Model.

  • Implementation and promotion of Data Platform, transformative data processes, and services.

  • Develop data pipelines and structures for Data Scientists, testing such to ensure that they are fit for use.

  • Maintain and model JSON-based schemas and metadata to re-use it across the organization (with central tools).

  • Resolving and troubleshooting data-related issues and queries.

  • Covering all processes from enterprise reporting to data science (incl. ML Ops).

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $150000 - $200000 Y ALMR Consulting Pte Ltd

Posted today

Job Viewed

Tap Again To Close

Job Description

Roles & Responsibilities

Job Summary:

We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.

Key Responsibilities:

  • Design and develop data ingestion, processing, and integration pipelines using Python, PySpark, and Informatica.
  • Analyse data requirements and build scalable data solutions.
  • Support testing, deployment, and production operations.
  • Collaborate with business and technical teams for smooth delivery.
  • Drive automation, standardization, and performance optimization.

Requirements:

  • Bachelor's degree in IT, Computer Science, or related field.
  • Minimum 5 years' experience in Big Data Engineering.
  • Hands-on skills in Python, PySpark, Linux, SQL, and ETL tools (Informatica preferred).
  • Experience with Cloudera Data Platform is an advantage.
  • Knowledge of data warehousing, Denodo, and reporting tools (SAP BO, Tableau) preferred.
  • Strong analytical, problem-solving, and communication skills.

Job Type: Contract

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $100000 - $150000 Y ALMR CONSULTING PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Summary:

We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.

Key Responsibilities:

  • Design and develop data ingestion, processing, and integration pipelines using Python, PySpark, and Informatica.
  • Analyse data requirements and build scalable data solutions.
  • Support testing, deployment, and production operations.
  • Collaborate with business and technical teams for smooth delivery.
  • Drive automation, standardization, and performance optimization.

Requirements:

  • Bachelor's degree in IT, Computer Science, or related field.
  • Minimum 5 years' experience in Big Data Engineering.
  • Hands-on skills in Python, PySpark, Linux, SQL, and ETL tools (Informatica preferred).
  • Experience with Cloudera Data Platform is an advantage.
  • Knowledge of data warehousing, Denodo, and reporting tools (SAP BO, Tableau) preferred.
  • Strong analytical, problem-solving, and communication skills.
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore ALMR CONSULTING PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Roles & Responsibilities

Job Summary:

We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.

Key Responsibilities:

  • Design and develop data ingestion, processing, and integration pipelines using Python, PySpark, and Informatica.
  • Analyse data requirements and build scalable data solutions.
  • Support testing, deployment, and production operations.
  • Collaborate with business and technical teams for smooth delivery.
  • Drive automation, standardization, and performance optimization.

Requirements:

  • Bachelor's degree in IT, Computer Science, or related field.
  • Minimum 5 years' experience in Big Data Engineering.
  • Hands-on skills in Python, PySpark, Linux, SQL, and ETL tools (Informatica preferred).
  • Experience with Cloudera Data Platform is an advantage.
  • Knowledge of data warehousing, Denodo, and reporting tools (SAP BO, Tableau) preferred.
  • Strong analytical, problem-solving, and communication skills.
Tell employers what skills you have

Tableau
PySpark
Scala
Big Data
Pipelines
Hadoop
Informatica
ETL
Data Engineering
SQL
Python
Communication Skills
Java
Data Warehousing
Databases
Linux
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore ARYAN SOLUTIONS PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Roles & Responsibilities

Experience


• Hands-on Big Data experience using common open-source components (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka).


• Experience in stakeholder management in heterogeneous business/technology organizations.


• Experience in banking or financial business, with handling sensitive data across regions.


• Experience in large data migration projects with on-prem Data Lakes.


• Hands-on experience in integrating Data Science Workbench platforms (e.g., KNIME, Cloudera, Dataiku).


• Track record in Agile project management and methods (e.g., Scrum, SAFe).

Skills


• Knowledge of reference architectures, especially concerning integrated, data-driven landscapes and solutions.


• Expert SQL skills, preferably in mixed environments (i.e., classic DWH and distributed).


• Working automation and troubleshooting experience in Python using Jupyter Notebooks or common IDEs.


• Data preparation for reporting/analytics and visualization tools (e.g., Tableau, Power BI or Python-based).


• Applying a data quality framework within the architecture.

Role description


• Datasets and data pipelines preparation, support for Business, data troubleshooting.


• Closely collaborate with the Data & Analytics Program Management and stakeholders to co-design Enterprise Data Strategy and Common Data Model.


• Implementation and promotion of Data Platform, transformative data processes, and services.


• Develop data pipelines and structures for Data Scientists, testing such to ensure that they are fit for use.


• Maintain and model JSON-based schemas and metadata to re-use it across the organization (with central tools).


• Resolving and troubleshooting data-related issues and queries.


• Covering all processes from enterprise reporting to data science (incl. ML Ops).

Tell employers what skills you have

cloudera
Workbench
Big Data
Pipelines
Hadoop
Data Quality
Spark
Program Management
SQL
Data Migration
Python
KNIME
Apache Kafka
Hive
Data Science
Metadata
Power BI
Data Strategy
This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Data engineer Jobs in Singapore !

Big Data Engineer

Singapore, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Roles & Responsibilities

Job Title: Big Data Engineer (Java, Spark, Hadoop)

Location: Singapore

Experience: 7- 12 years

Employment Type: Full-Time

Open to Citizens and SPR only | No Visa sponsorship available

Job Summary

We are looking for a Senior Big Data Engineerwith 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep expertise in Java, Apache Spark, and Hadoop ecosystems, and have a strong track record of designing and building scalable, high-performance big data solutions. This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics.

Key Responsibilities

● Design, build, and optimize large-scale, distributed data processing systems using Apache Spark, Hadoop, and Java.

● Lead the development and deployment of data ingestion, ETL/ELT pipelines, and data transformation frameworks.

● Work with cross-functional teams to gather data requirements and translate them into scalable data solutions.

● Ensure high performance and reliability of big data systems through performance tuning and best practices.

● Manage and monitor batch and real-time data pipelines from diverse sources including APIs, databases, and streaming platforms like Kafka.

● Apply deep knowledge of Java to build efficient, modular, and reusable codebases.

● Mentor junior engineers, participate in code reviews, and enforce engineering best practices.

● Collaborate with DevOps teams to build CI/CD pipelines and automate deployment processes.

● Ensure data governance, security, and compliance standards are maintained.

Required Qualifications

● 7–12 years of experience in big data engineering or backend data systems.

● Strong hands-on programming skills in Java; exposure to Scala or Python is a plus.

● Proven experience with Apache Spark, Hadoop (HDFS, YARN, MapReduce), and related tools.

● Solid understanding of distributed computing, data partitioning, and optimization techniques.

● Experience with data access and storage layers like Hive, HBase, or Impala.

● Familiarity with data ingestion tools like Apache Kafka, NiFi, Flume, or Sqoop.

● Comfortable working with SQL for querying large datasets.

● Good understanding of data architecture, data modeling, and data lifecycle management.

● Experience with cloud platforms like AWS, Azure, or Google Cloud Platform.

● Strong problem-solving, analytical, and communication skills.

Preferred Qualifications

● Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

● Experience with streaming data frameworks such as Spark Streaming, Kafka Streams, or Flink.

● Knowledge of DevOps practices, CI/CD pipelines, and infrastructure as code (e.g., Terraform).

● Exposure to containerization (Docker) and orchestration (Kubernetes).

● Certifications in Big Data technologies or Cloud platforms are a plus.

To apply, email to / with the following details – Current CTC, Expected CTC, Notice period and Residential Status.

Tell employers what skills you have

Apache Spark
Scala
Azure
Big Data
Data Modeling
Pipelines
Hadoop
Data Governance
MapReduce
Data Engineering
SQL
Python
Data Architecture
Docker
Java
Databases
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Title: Big Data Engineer (Java, Spark, Hadoop)
Location : Singapore
Experience : 7- 12 years
Employment Type : Full-Time
Open to Citizens and SPR only | No Visa sponsorship available
Job Summary
We are looking for a
Senior Big Data Engineer
with
7–12 years of experience
to join our growing data engineering team. The ideal candidate will bring deep expertise in
Java ,
Apache Spark , and
Hadoop
ecosystems, and have a strong track record of designing and building scalable, high-performance big data solutions. This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics.
Key Responsibilities
Design, build, and optimize
large-scale, distributed data processing systems
using
Apache Spark ,
Hadoop , and
Java .
Lead the development and deployment of
data ingestion ,
ETL/ELT pipelines , and
data transformation frameworks .
Work with cross-functional teams to gather data requirements and translate them into scalable data solutions.
Ensure high performance and reliability of big data systems through performance tuning and best practices.
Manage and monitor
batch and real-time data pipelines
from diverse sources including APIs, databases, and streaming platforms like
Kafka .
Apply deep knowledge of
Java
to build efficient, modular, and reusable codebases.
Mentor junior engineers, participate in code reviews, and enforce engineering best practices.
Collaborate with DevOps teams to build CI/CD pipelines and automate deployment processes.
Ensure
data governance ,
security , and
compliance
standards are maintained.
Required Qualifications
7–12 years of experience
in big data engineering or backend data systems.
Strong hands-on programming skills in
Java ; exposure to
Scala
or
Python
is a plus.
Proven experience with
Apache Spark ,
Hadoop
(HDFS, YARN, MapReduce), and related tools.
Solid understanding of
distributed computing , data partitioning, and optimization techniques.
Experience with data access and storage layers like
Hive ,
HBase , or
Impala .
Familiarity with data ingestion tools like
Apache Kafka ,
NiFi ,
Flume , or
Sqoop .
Comfortable working with
SQL
for querying large datasets.
Good understanding of
data architecture ,
data modeling , and
data lifecycle management .
Experience with cloud platforms like
AWS ,
Azure , or
Google Cloud Platform .
Strong problem-solving, analytical, and communication skills.
Preferred Qualifications
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
Experience with
streaming data frameworks
such as
Spark Streaming ,
Kafka Streams , or
Flink .
Knowledge of
DevOps practices , CI/CD pipelines, and infrastructure as code (e.g., Terraform).
Exposure to
containerization (Docker)
and
orchestration (Kubernetes) .
Certifications in
Big Data technologies
or
Cloud platforms
are a plus.
Please note that this is an equal opportunities employer.
#J-18808-Ljbffr

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

$10500 Monthly ALMR CONSULTING PTE. LTD.

Posted 15 days ago

Job Viewed

Tap Again To Close

Job Description

Job Summary:
We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.


Key Responsibilities:

  • Design and develop data ingestion, processing, and integration pipelines using Python, PySpark, and Informatica.
  • Analyse data requirements and build scalable data solutions.
  • Support testing, deployment, and production operations.
  • Collaborate with business and technical teams for smooth delivery.
  • Drive automation, standardization, and performance optimization.

Requirements:

  • Bachelor’s degree in IT, Computer Science, or related field.
  • Minimum 5 years’ experience in Big Data Engineering.
  • Hands-on skills in Python, PySpark, Linux, SQL, and ETL tools (Informatica preferred).
  • Experience with Cloudera Data Platform is an advantage.
  • Knowledge of data warehousing, Denodo, and reporting tools (SAP BO, Tableau) preferred.
  • Strong analytical, problem-solving, and communication skills.
This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Data Engineer Jobs