Big Data Engineer

Singapore, Singapore $80000 - $120000 Y TikTok Pte. Ltd.

Posted today

Job Viewed

Tap Again To Close

Job Description

Responsibilities

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa. About the team Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users.

We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.

  • Design and implement a reasonable offline data architecture for large-scale recommendation systems
  • Design and implement flexible, scalable, stable and high-performance storage and computing systems
  • Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
  • Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems
  • Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
  • Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
  • Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

Minimum Qualifications

  • Bachelor's degree or above, majoring in Computer Science, or related fields, with at least 1 year of experience
  • Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
  • Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang
  • Effective communication skills and a sense of ownership and drive
  • Experience of Peta Byte level data processing is a plus
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore $80000 - $120000 Y UNISON Group

Posted today

Job Viewed

Tap Again To Close

Job Description

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. Candidate will also be integrating data sets to provide seamless data access to users.

SKILLS SET AND TRACK RECORD

  • Good understanding and completion of projects using waterfall/Agile methodology.
  • Analytical, conceptualisation and problem-solving skills.
  • Good understanding of analytics and data warehouse implementations
  • Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica
  • Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage
  • Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred
  • Track record in implementing systems using Cloudera Data Platform will be an added advantage.
  • Motivated and self-driven, with ability to learn new concepts and tools in a short period of time
  • Passion for automation, standardization, and best practices
  • Good presentation skills are preferred

The developer is responsible to:

  • Analyse the Client data needs and document the requirements.
  • Refine data collection/consumption by migrating data collection to more efficient channels
  • Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
  • Develop test plan and scripts for system testing, support user acceptance testing.
  • Work with the Client technical teams to ensure smooth deployment and adoption of new solution.
  • Ensure the smooth operations and service level of IT solutions.
  • Support production issues
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore TIKTOK PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Job highlights
Positive team atmosphere, Flat organization, Industry experts
Responsibilities
TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa.
About the team
Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.
Responsibilities
- Design and implement a reasonable offline data architecture for large-scale recommendation systems
- Design and implement flexible, scalable, stable and high-performance storage and computing systems
- Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
- Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems
- Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
- Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
- Visualise, interpret, and report data findings and may create dynamic data reports as well
Qualifications
Minimum Qualifications
- Bachelor's degree or above, majoring in Computer Science, or related fields, with at 3+ years of experience
- Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
- Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang
- Effective communication skills and a sense of ownership and drive
- Experience of Peta Byte level data processing is a plus

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Singapore, Singapore QUESS SELECTION & SERVICES PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

Roles & Responsibilities

Key Responsibilities:

  • Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala.
  • Implement and optimize data pipelines using Apache Spark to handle large data sets efficiently.
  • Perform ETL processes to move data between systems, using tools like Sqoop and custom Shell Scripts.
  • Collaborate with data scientists and analysts to integrate business intelligence tools such as Tableau for data visualization and reporting.
  • Manage databases and data warehouses such as MySQL, Oracle, and Cloudera to ensure data integrity and availability.
  • Utilize version control systems like Git and Bitbucket for code management and collaboration.
  • Automate deployment and CI/CD pipelines with tools like Jenkins, Maven, and Autosys.
  • Work closely with the development teams using Eclipse and IntelliJ for coding and debugging.
  • Collaborate with cross-functional teams using tools such as Jira, Confluence, and ServiceNow to manage projects and incident reporting.
  • Ensure data governance, security, and compliance with company policies and regulations.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 5 years of experience into IT field.
  • Proven experience with HDFS, MapReduce, Hive, Spark, Sqoop, and other Hadoop ecosystem tools.
  • Proficiency in Shell Scripting and automation of data processing tasks.
  • Strong experience in database management systems like MySQL and Oracle.
  • Familiarity with Tableau for creating interactive dashboards and reports.
  • Experience with Git, Bitbucket, Jenkins, Maven, and Autosys for source control and continuous integration.
  • Hands-on experience with ticketing and project management tools like Jira, Confluence, and ServiceNow.
  • Experience in working with IntelliJ and Eclipse for development.
  • Strong analytical and problem-solving skills with a focus on delivering scalable data solutions.
  • Experience in cloud platforms such as AWS, Azure, or GCP.
  • Knowledge of DevOps practices and CI/CD pipeline automation.
  • Familiarity with ServiceNow for IT service management.

Savita Rai

EA REG NO: R

EA License No:23C2060

Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)

Tell employers what skills you have

Version Control
Confluence
Apache Spark
Eclipse
Azure
Pipelines
Hadoop
MySQL
ETL
Data Governance
MapReduce
JIRA
Distributed Systems
Business Intelligence Tools
Debugging
Databases
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer & Architect

Singapore, Singapore beBeeDataEngineer

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Title: Data Engineer & Architect

About the Role:

We are seeking a highly skilled and motivated Data Engineer & Architect to join our team. As a Data Engineer & Architect, you will be responsible for designing, developing, and deploying data pipelines using Python and PySpark in cloud-based environments.

Key Responsibilities:
  • Design and implement data pipelines using Python and PySpark in AWS and Google Cloud Platform (GCP) environments.
  • Coding using Python and PySpark in cloud-based environments involving big-data frameworks in AWS resources like EMR, Lambda, S3 bucket, RDS, EC2, ECS, EKS etc.
  • Experience in ETL frameworks for data ingestion, data pipeline to Snowflake Data Warehouse at high-frequency & volume scenarios (giga / tera-bytes of data ingestions per day / month).
  • Optimize pyspark jobs for performance, efficiency, troubleshoot issues, ensure data quality and availability.
  • Implement processes for automating data delivery, monitoring data quality, production deployment.
  • The candidate should be an expert in development with hands-on experience in leveraging Git/GitLab based repository management with understanding of Government Commercial Cloud (GCC) requirements.
  • Proficient in consulting communication skills - good in articulating business problem, approach for solution, respond to changes in scenarios for business problems.
  • Degree in Computer Science, Computer Engineering or any STEM equivalent.
  • Familiar with working in Government Commercial Cloud (GCC) environment.
  • Independent and self-motivated contributor and passionate about software development.
What We Offer:

A dynamic work environment with opportunities for growth and development.

An excellent salary package that reflects your skills and qualifications.

Ongoing training and support to help you achieve your career goals.

A collaborative and inclusive team culture that values diversity and creativity.

Flexible working arrangements to suit your needs.

Access to cutting-edge technology and tools to help you stay ahead of the curve.

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer, Data Ingestion

Singapore, Singapore BYTEDANCE PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Job highlights

Positive team atmosphere, Career growth opportunity, Paid leave, Meals provided

Responsibilities

About the Team

The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity.

As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.

Responsibilities:

- Design, develop, and optimize the architecture of large-scale data ingestion systems to support real-time data pipelines, ensuring high throughput, low latency, and fault tolerance.

- Enhance the performance, scalability, and reliability of data ingestion pipelines.

- Develop and implement automated and intelligent operation and maintenance systems to monitor, diagnose, and ensure the stability and reliability of data ingestion pipelines. -

Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions that meet diverse business requirements.

- Troubleshoot and resolve complex issues in production systems, ensuring minimal downtime and optimal performance.

Qualifications

Minimum Qualifications:

- Bachelor's degree in Computer Science or equivalent practical experience.

- 2+ years of experience in software development with proficiency in one or more programming languages, such as Java, Scala, Python, or Go.

- Strong understanding of data structures, algorithms, and distributed systems principles.

- Hands-on experience with big data technologies, such as Hadoop, Flink, Kafka, or similar frameworks.

Preferred Qualifications:

- 2+ years of experience in real-time data processing frameworks like Flink. Contributions to open-source projects are a plus.

- Experience in the event tracking domain, including event collection, real-time processing, governance, quality assurance and cost optimization.

- Deep understanding of data lakehouse architectures and the integration of stream and batch processing.

- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer, Data Ingestion

048583 Raffles Quay, Singapore $22500 Monthly BYTEDANCE PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.


Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.


As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.


Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Job highlights

Positive team atmosphere, Career growth opportunity, Paid leave, Meals provided


Responsibilities

About the Team

The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity.


As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.


Responsibilities:

- Design, develop, and optimize the architecture of large-scale data ingestion systems to support real-time data pipelines, ensuring high throughput, low latency, and fault tolerance.

- Enhance the performance, scalability, and reliability of data ingestion pipelines.

- Develop and implement automated and intelligent operation and maintenance systems to monitor, diagnose, and ensure the stability and reliability of data ingestion pipelines. -

Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions that meet diverse business requirements.

- Troubleshoot and resolve complex issues in production systems, ensuring minimal downtime and optimal performance.


Qualifications

Minimum Qualifications:

- Bachelor's degree in Computer Science or equivalent practical experience.

- 2+ years of experience in software development with proficiency in one or more programming languages, such as Java, Scala, Python, or Go.

- Strong understanding of data structures, algorithms, and distributed systems principles.

- Hands-on experience with big data technologies, such as Hadoop, Flink, Kafka, or similar frameworks.


Preferred Qualifications:

- 2+ years of experience in real-time data processing frameworks like Flink. Contributions to open-source projects are a plus.

- Experience in the event tracking domain, including event collection, real-time processing, governance, quality assurance and cost optimization.

- Deep understanding of data lakehouse architectures and the integration of stream and batch processing.

- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.

This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Senior data engineer Jobs in Singapore !

Big Data Engineer, Data Ingestion

048583 Raffles Quay, Singapore $14000 Monthly BYTEDANCE PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.


Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.


As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.


Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.


Job highlights

Positive team atmosphere, Career growth opportunity, Paid leave, Meals provided


Responsibilities

About the Team

The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity.


As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.


Responsibilities:

- Design, develop, and optimize the architecture of large-scale data ingestion systems to support real-time data pipelines, ensuring high throughput, low latency, and fault tolerance.

- Enhance the performance, scalability, and reliability of data ingestion pipelines.

- Develop and implement automated and intelligent operation and maintenance systems to monitor, diagnose, and ensure the stability and reliability of data ingestion pipelines. -

Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions that meet diverse business requirements.

- Troubleshoot and resolve complex issues in production systems, ensuring minimal downtime and optimal performance.


Qualifications

Minimum Qualifications:

- Bachelor's degree in Computer Science or equivalent practical experience.

- 2+ years of experience in software development with proficiency in one or more programming languages, such as Java, Scala, Python, or Go.

- Strong understanding of data structures, algorithms, and distributed systems principles.

- Hands-on experience with big data technologies, such as Hadoop, Flink, Kafka, or similar frameworks.


Preferred Qualifications:

- 2+ years of experience in real-time data processing frameworks like Flink. Contributions to open-source projects are a plus.

- Experience in the event tracking domain, including event collection, real-time processing, governance, quality assurance and cost optimization.

- Deep understanding of data lakehouse architectures and the integration of stream and batch processing.

- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer, Monetization Data

Singapore, Singapore TIKTOK PTE. LTD.

Posted today

Job Viewed

Tap Again To Close

Job Description

About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Job highlights
Positive team atmosphere, Career growth opportunity, Flat organization, Competitive compensation
Responsibilities
- Work closely with Product Managers, Data Scientists/Analysts, and Software/Machine Learning Engineers and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
- Evaluate, implement and maintain data infrastructure tools and technologies to support efficient data processing, storage and query.
- Design, build and optimize scalable data pipelines to ingest, process and transform large volumes of data.
- Design and implement robust data models and visualization to support complex analytical queries and reporting requirements.
- Ensure the data integrity, accuracy and consistency of data by implementing data quality checks, validation processes and monitoring mechanisms.
- Continously optimize data pipelines, queries and processes to improve performance, reduce latency and enhance scalability.
- Provide rapid response to SLA oncall support to business critical data pipelines.
- Create and maintain good documentation for data assets and promote best practices for data governance within the data user community.
Minimum Qualifications:
- Bachelor's degree or higher in Computer Science
- Minimum 4 years of experience in building data systems from 0 to 1
- Minimum 4 years of experience in SQL with hands-on experience in relational (e.g., MySQL, Postgres) and non-relational (e.g., NoSQL, ODPS and Hive) databases.
- Minimum 4 years of experience in data warehouse frameworks such as ODPS, Flink and Lambda architectures.
- Proficiency in programming languages such as Python and Java.
- Solid understanding of data modeling and data warehousing concepts, data integration and ETL techniques.
Preferred Qualifications
- Effective communication skills and ability to collaborate effectively with cross-functional teams.
- Excellent problem-solving skills, attention to detail, and ability to thrive in a fast-paced environment
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer - Scalable Solutions

Singapore, Singapore beBeeDataEngineer

Posted today

Job Viewed

Tap Again To Close

Job Description

About the Data Management Suite Team

The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to significantly boost their productivity.

As a software engineer in this team, you will have the opportunity to design, optimize, and grow one of the world's largest data platforms. You'll gain hands-on experience with core systems in the data platform ecosystem, directly impacting the company's core products and hundreds of millions of users.

We are seeking talented individuals who can help us achieve our goals.

  • Ensure production stability for big data development and governance systems.
  • Engage in and improve the whole lifecycle of services, from inception and design through deployment, operation, and refinement.
  • Maintain services once they are live by measuring and monitoring availability, latency, and overall system health. Practice sustainable incident response and blameless postmortems.
  • Establish best engineering practices for engineers and non-technical staff.
  • Design and implement reliable, scalable, robust, and extensible big data systems that support core products and business.

Key qualifications include:

Minimum Qualifications

  • Pursuing an Undergraduate or Master's degree in Computer Science or a related technical field.
  • Experience with site reliability engineering, monitoring, and alerting for big data-related systems.
  • Proficiency in writing code in Java, Go, Python, or similar languages.

Preferred Qualifications

  • Familiarity with data ingestion, modeling, processing, and persistence strategies, ETL design, job scheduling, and dimensional modeling.
  • Experience running production-grade services at scale and understanding cloud-native technologies and networking.
  • Ability to develop tools and APIs reducing human interaction with systems and applications using coding and scripting standards.
  • Expertise in designing, analyzing, and troubleshooting large-scale distributed systems (Hadoop, M/R, Hive, Spark, Presto, Flume, Kafka, ClickHouse, Flink).
  • Systematic problem-solving approach and effective communication skills.
This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Senior Data Engineer Jobs View All Jobs in Singapore