278 Big Data jobs in Singapore

Big Data Engineering Lead

Singapore, Singapore NEWBRIDGE ALLIANCE PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Roles & Responsibilities

We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.

Key Responsibilities:

  1. Design and develop large-scale data pipelines using Scala, Python, and PySpark
  2. Lead and mentor a team of data engineers to build and maintain data architectures
  3. Collaborate with cross-functional teams to identify data requirements and implement data-driven solutions
  4. Ensure data quality, integrity, and security across all data pipelines
  5. Develop and maintain technical documentation for data pipelines and architectures
  6. Stay up-to-date with industry trends and emerging technologies in big data, cloud computing, and data engineering
  7. Drive technical innovation and recommend new tools and technologies to improve data engineering capabilities

Requirements:

  1. 5+ years of experience in big data engineering, with expertise in Scala, Python, and PySpark
  2. Strong experience with big data technologies such as Apache Spark, Hadoop, and Kafka
  3. Experience with cloud-based data platforms such as AWS, GCP, or Azure
  4. Strong understanding of data architecture, data governance, and data security
  5. Excellent leadership and mentoring skills, with experience leading high-performing teams
  6. Strong communication and collaboration skills, with ability to work with cross-functional teams
  7. Bachelor's or Master's degree in Computer Science, Engineering, or related field
Tell employers what skills you have

Mentoring
Technical Documentation
PySpark
Apache Spark
Scala
Azure
Big Data
Cloud Computing
Pipelines
Hadoop
Data Quality
Data Governance
Data Engineering
Python
Data Architecture
GCP
This advertiser has chosen not to accept applicants from your region.

Big Data Engineering Lead

079903 Anson Road, Singapore $20000 Monthly NEWBRIDGE ALLIANCE PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.


Key Responsibilities:

  1. Design and develop large-scale data pipelines using Scala, Python, and PySpark
  2. Lead and mentor a team of data engineers to build and maintain data architectures
  3. Collaborate with cross-functional teams to identify data requirements and implement data-driven solutions
  4. Ensure data quality, integrity, and security across all data pipelines
  5. Develop and maintain technical documentation for data pipelines and architectures
  6. Stay up-to-date with industry trends and emerging technologies in big data, cloud computing, and data engineering
  7. Drive technical innovation and recommend new tools and technologies to improve data engineering capabilities

Requirements:

  1. 5+ years of experience in big data engineering, with expertise in Scala, Python, and PySpark
  2. Strong experience with big data technologies such as Apache Spark, Hadoop, and Kafka
  3. Experience with cloud-based data platforms such as AWS, GCP, or Azure
  4. Strong understanding of data architecture, data governance, and data security
  5. Excellent leadership and mentoring skills, with experience leading high-performing teams
  6. Strong communication and collaboration skills, with ability to work with cross-functional teams
  7. Bachelor's or Master's degree in Computer Science, Engineering, or related field
This advertiser has chosen not to accept applicants from your region.

Big Data Developer

Singapore, Singapore $80000 - $120000 Y DADACONSULTANTS PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

My Client

It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the dynamic team. The role involves working closely with other developers, designers, and product managers to create high-quality, user-friendly mobile apps that deliver exceptional user experiences.

Key Responsibilities:

  • Develop scalable data processing architectures using Hadoop, Flink, and other Big Data tools.
  • Implement and optimize data ingestion, transformation, and analysis pipelines.
  • Design efficient data storage and retrieval mechanisms to support analytical needs.
  • Work closely with business stakeholders to translate requirements into technical solutions.
  • Ensure data quality, security, and compliance with industry standards.
  • Identify and resolve performance bottlenecks in data processing systems.
  • Keep up with advancements in Big Data technologies and recommend improvements.

Requirements:

  • Degree in Computer Science, Information Technology, or a related field.
  • 3+ years of hands-on experience in Big Data engineering.
  • Proficiency in Hadoop, Flink, Kafka, and related frameworks.
  • Experience with database modeling and large-scale data storage solutions.
  • Strong understanding of data security best practices.
  • Excellent analytical and troubleshooting skills.
  • Effective communication and teamwork capabilities.
  • A proactive mindset with a passion for data-driven innovation.

If it sounds like your next move, please don't hesitate to apply. Kindly note that only shortlisted candidates will be contacted. Appreciate your understanding. Data provided is for recruitment purposes only.

About Us

Dada Consultants was established in 2017, with the commitment of providing the best recruitment services in Singapore. We are comprised of a dynamic head-hunting team dedicated to sourcing for highly competent professionals in IT industry. We provide enterprises with customized talent solutions, and bring talents to career advancement.

EA Registration Number: R

Business Registration Number: W. Licence Number: 18S9037

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $80000 - $120000 Y TikTok Pte. Ltd.

Posted today

Job Viewed

Tap Again To Close

Job Description

Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa. About the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users.

We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.

  • Design and implement a reasonable offline data architecture for large-scale recommendation systems
  • Design and implement flexible, scalable, stable and high-performance storage and computing systems
  • Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
  • Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems
  • Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
  • Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
  • Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

Minimum Qualifications

  • Bachelor's degree or above, majoring in Computer Science, or related fields, with at least 1 year of experience
  • Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
  • Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang
  • Effective communication skills and a sense of ownership and drive
  • Experience of Peta Byte level data processing is a plus
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $80000 - $120000 Y UNISON Group

Posted today

Job Viewed

Tap Again To Close

Job Description

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. Candidate will also be integrating data sets to provide seamless data access to users.

SKILLS SET AND TRACK RECORD

  • Good understanding and completion of projects using waterfall/Agile methodology.
  • Analytical, conceptualisation and problem-solving skills.
  • Good understanding of analytics and data warehouse implementations
  • Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica
  • Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage
  • Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred
  • Track record in implementing systems using Cloudera Data Platform will be an added advantage.
  • Motivated and self-driven, with ability to learn new concepts and tools in a short period of time
  • Passion for automation, standardization, and best practices
  • Good presentation skills are preferred

The developer is responsible to:

  • Analyse the Client data needs and document the requirements.
  • Refine data collection/consumption by migrating data collection to more efficient channels
  • Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
  • Develop test plan and scripts for system testing, support user acceptance testing.
  • Work with the Client technical teams to ensure smooth deployment and adoption of new solution.
  • Ensure the smooth operations and service level of IT solutions.
  • Support production issues
This advertiser has chosen not to accept applicants from your region.

Big Data Innovator

Singapore, Singapore beBeeData

Posted today

Job Viewed

Tap Again To Close

Job Description

About Us

We are a data-driven organization that aims to inspire creativity and bring joy to our users. Our mission is to help people authentically express themselves, discover and connect with others.

We have a global presence with offices in various locations around the world. Our teams are diverse and inclusive, making us a great place to work for those who share our values.


Job Highlights
  • Flat organizational structure
  • Career growth opportunities
  • Positive team atmosphere

As a Big Data Engineer, you will be working closely with cross-functional teams to understand data requirements and deliver data solutions that meet business needs. You will be responsible for designing, building and optimizing scalable data pipelines, ensuring data integrity and accuracy.


Responsibilities
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore TIKTOK PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Job highlights
Positive team atmosphere, Flat organization, Industry experts
Responsibilities
TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa.
About the team
Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.
Responsibilities
- Design and implement a reasonable offline data architecture for large-scale recommendation systems
- Design and implement flexible, scalable, stable and high-performance storage and computing systems
- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
- Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
- Visualise, interpret, and report data findings and may create dynamic data reports as well
Qualifications
Minimum Qualifications
- Bachelor's degree or above, majoring in Computer Science, or related fields, with at 3+ years of experience
- Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
- Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang
- Effective communication skills and a sense of ownership and drive
- Experience of Peta Byte level data processing is a plus

This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Big data Jobs in Singapore !

Big Data Specialist

Singapore, Singapore beBeeData

Posted today

Job Viewed

Tap Again To Close

Job Description

As a data processing specialist, you will be responsible for developing and maintaining large-scale data processing systems using SQL and Hadoop technologies.

Your key responsibilities will include:

  • Designing and implementing efficient data processing workflows using SQL and Hadoop
  • Developing and deploying scalable data pipelines using big data technologies
  • Collaborating with cross-functional teams to integrate data solutions into business applications
  • Analyzing complex technical issues and providing creative solutions

To succeed in this role, you will need:

  • 3-5 years of software development experience
  • Good experience in SQL development
  • Knowledge in Spark and Hadoop
  • Excellent problem-solving and analytical skills

Having banking knowledge is an added advantage.

This position offers opportunities for growth and professional development in a dynamic environment. If you are passionate about working with big data and SQL technologies, we encourage you to apply.

This advertiser has chosen not to accept applicants from your region.

Big Data Strategist

Singapore, Singapore beBeeData

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Overview

We are seeking a seasoned Technical Architect to drive the design and implementation of our big data platform.

    This advertiser has chosen not to accept applicants from your region.

    Big Data Developer

    Singapore, Singapore beBeeData

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Deliver high-quality big data solutions for clients across various industries by working with our team as a skilled and experienced SQL & Hadoop Developer.

    We are looking for an individual with excellent problem-solving skills, able to communicate effectively and possessing a strong understanding of SQL and Hadoop.

    The ideal candidate should have at least 3-4 years of experience in this field.

    Key qualifications include good knowledge of SQL, Spark, and Hadoop, as well as good communication skills. Having banking knowledge is an added advantage.

    Job Requirements
    • Job Title: SQL & Hadoop Developer
    • Location: Singapore
    • Experience: Minimum 3-4 years of experience.

    Key Skills: Good in SQL, Must have knowledge in Spark & Hadoop, Good communication skills, Having Banking knowledge is added advantage.

    Why Join Us

    Avensys is a global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services.

    As a dynamic and innovative team, we deliver high-quality solutions for clients across various industries. We look for passionate individuals who want to be part of our team and contribute to the success of our projects.

    Tell Employers What You Can Do
    Managed Services
    Business Intelligence
    Process Automation
    Big Data
    Pipelines
    Healthcare
    Hadoop
    Supply Chain
    Information Technology
    MapReduce
    SQL
    Good Communication Skills
    Banking
    Consulting
    Business Process
    Professional Services

    This advertiser has chosen not to accept applicants from your region.
     

    Nearby Locations

    Other Jobs Near Me

    Industry

    1. request_quote Accounting
    2. work Administrative
    3. eco Agriculture Forestry
    4. smart_toy AI & Emerging Technologies
    5. school Apprenticeships & Trainee
    6. apartment Architecture
    7. palette Arts & Entertainment
    8. directions_car Automotive
    9. flight_takeoff Aviation
    10. account_balance Banking & Finance
    11. local_florist Beauty & Wellness
    12. restaurant Catering
    13. volunteer_activism Charity & Voluntary
    14. science Chemical Engineering
    15. child_friendly Childcare
    16. foundation Civil Engineering
    17. clean_hands Cleaning & Sanitation
    18. diversity_3 Community & Social Care
    19. construction Construction
    20. brush Creative & Digital
    21. currency_bitcoin Crypto & Blockchain
    22. support_agent Customer Service & Helpdesk
    23. medical_services Dental
    24. medical_services Driving & Transport
    25. medical_services E Commerce & Social Media
    26. school Education & Teaching
    27. electrical_services Electrical Engineering
    28. bolt Energy
    29. local_mall Fmcg
    30. gavel Government & Non Profit
    31. emoji_events Graduate
    32. health_and_safety Healthcare
    33. beach_access Hospitality & Tourism
    34. groups Human Resources
    35. precision_manufacturing Industrial Engineering
    36. security Information Security
    37. handyman Installation & Maintenance
    38. policy Insurance
    39. code IT & Software
    40. gavel Legal
    41. sports_soccer Leisure & Sports
    42. inventory_2 Logistics & Warehousing
    43. supervisor_account Management
    44. supervisor_account Management Consultancy
    45. supervisor_account Manufacturing & Production
    46. campaign Marketing
    47. build Mechanical Engineering
    48. perm_media Media & PR
    49. local_hospital Medical
    50. local_hospital Military & Public Safety
    51. local_hospital Mining
    52. medical_services Nursing
    53. local_gas_station Oil & Gas
    54. biotech Pharmaceutical
    55. checklist_rtl Project Management
    56. shopping_bag Purchasing
    57. home_work Real Estate
    58. person_search Recruitment Consultancy
    59. store Retail
    60. point_of_sale Sales
    61. science Scientific Research & Development
    62. wifi Telecoms
    63. psychology Therapy
    64. pets Veterinary
    View All Big Data Jobs View All Jobs in Singapore