380 Big Data Technologies jobs in Singapore

We are seeking a highly skilled Junior Data Engineer to join our team. As a Junior Data Engineer, you will play a crucial role in designing and implementing ETL/ELT pipelines and data workflows that ensure data quality, consistency, and integrity across sources.

• Design and implement scalable data warehousing solutions
• Manage and maintain high-quality data pipelines
• Collaborate with cross-functional teams to ensure seamless data integration

• 0-1 year of experience in data engineering or a related field
• Polytechnic diploma or degree in computer science or data science
• Freshers with decent SQL scripting skills will be considered
• Strong communication skills and ability to work in a team

• A dynamic and collaborative work environment
• Opportunities for professional growth and development
• A competitive salary and benefits package

To succeed in this role, you will need to have a strong foundation in data engineering principles and practices, as well as excellent problem-solving and communication skills.

**Job Description**: We are seeking a seasoned technical leader to oversee our data engineering, backend, frontend, and MLOps domains. The ideal candidate will have expertise in technical leadership, architecture, and DevOps practices.

**Required Skills and Qualifications**:

• Technical leadership and architecture expertise
• Experience with DevOps practices and infrastructure management
• Strong understanding of system architecture, design patterns, and technical decisions
• Ability to establish coding standards, best practices, and technical documentation requirements
• Evaluate and recommend new technologies and tools to improve development efficiency

**Benefits**: As a member of our team, you will have the opportunity to work on challenging projects, collaborate with experienced professionals, and contribute to the growth and success of our organization.

**Others**: If you are a motivated and detail-oriented individual with a passion for technology, we encourage you to apply for this exciting opportunity.

We are seeking a highly skilled and experienced Cloud Data Engineering Leader to spearhead our cloud-based data initiatives.

This role will be responsible for architecting, building, and maintaining scalable data pipelines and platforms in the cloud, enabling advanced analytics and data-driven decision-making across the organization.

• Leadership & Strategy
  • Lead a team of data engineers in designing and implementing cloud-native data solutions.
  • Define and drive the data engineering roadmap aligned with business goals.
  • Collaborate with cross-functional teams, including Data Science, Analytics, DevOps, and Product.
• Architecture & Development
  • Architect and implement scalable, secure, and cost-effective data pipelines and platforms.
  • Design and optimize data lake, data warehouse, and real-time streaming architectures.
  • Ensure high availability, performance, and reliability of data systems.
• Cloud & Tools
  • Leverage cloud platforms (AWS, Azure) for data storage, processing, and orchestration.

Utilize tools such as Snowflake, Data Bricks, AWS Glue, Iceberg, Apache Spark, Airflow, Kafka, dbt, and Terraform.

• Implement CI/CD pipelines and infrastructure-as-code for data workflows.
• Governance & Quality
  • Establish data governance, security, and compliance standards.
  • Monitor data quality and implement automated validation and alerting mechanisms.
• Mentorship & Growth
  • Mentor junior engineers and foster a culture of continuous learning and innovation.
  • Conduct code reviews, technical workshops, and performance evaluations.

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• 7+ years of experience in data engineering, with 2+ years in a leadership role.
• Proven expertise in cloud platforms (AWS, Azure).
• Strong programming skills in Python, Scala, or Java.
• Experience with big data technologies (Spark, Hadoop), ETL tools, and SQL.
• Familiarity with data modeling, warehousing, and real-time data processing.
• Excellent communication, leadership, and project management skills.

We are seeking a skilled professional to lead the design, implementation and maintenance of scalable data pipelines and architectures.

The ideal candidate will have a solid understanding of ETL processes, data warehousing concepts and data modeling best practices.

• Design and develop robust data pipelines and architectures to support data ingestion, processing and storage.
• Develop and optimize complex SQL queries and stored procedures for data extraction, transformation and analysis.
• Model data to meet different use cases and automate data workflows.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Lead the integration of data from various sources into data lakes and warehouses.
• Monitor and troubleshoot data pipelines and workflows to ensure optimal performance and reliability.

• Minimum 3 years of experience in data engineering fields with system integration.
• Proven solutions: demonstrated experience in providing effective working solutions particularly in cloud-based environments.

• Proficiency in Databricks, Azure Data lake, PowerBI, Tableau and related data processing and visualization software.
• Familiarity with Windows, Linux, AWS and/or Azure platforms.
• Strong programming skills in languages such as Python and R.

Join a forward-thinking team that is transforming government digital services.

Thrive in a dynamic environment where you can utilize your technical expertise to drive business success.

Enjoy a collaborative work culture that fosters innovation and creativity.

Work on challenging projects that help shape the future of government digital services.

• Develop scalable and secure data pipelines and architectures.
• Collaborate with cross-functional teams to translate data needs into effective data engineering solutions.
• Manage and optimize data ingestion, transformation, and storage processes across structured and unstructured data sources.
• Ensure data quality, integrity, and governance across all data platforms.

Required Skills:

• Bachelor's degree (or above) in Computer Science, Data Engineering, Information Systems, or a related field.
• At least 8 years of experience in data engineering, with a strong background in building and managing data pipelines and architectures.

Mandatory Requirements:

• Hands-on experience with cloud-based data platforms (AWS preferred or Azure, or GCP).
• Proficiency in data pipeline tools (e.g., Apache Airflow, Kafka, Spark).
• Strong SQL skills and experience with relational and NoSQL databases.
• Strong Python programming skills.
• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Familiarity with data governance, security, and compliance in healthcare or regulated environments.

We are seeking an experienced Data Engineer with a keen interest in Government projects.

• Design and implement large-scale data pipelines for ingestion of data into our data platform.
• Maintain and review scripts as part of the ETL process to support business requirements.
• Build and maintain data marts and data models for data management and storage.
• Experiment and implement new data tools into the data platform.
• Document data life processes through various stages in the data platform.

To be successful in this role, you will need:

• A degree in Computer Science or equivalent.
• Strong analytical and data-related skills.
• At least 3 years in data engineering and data management.
• Good interpersonal and communication skills, able to work independently.

We offer a dynamic work environment and opportunities for growth and development.

Job Title:

We are seeking a skilled Data Engineer to support the adoption of next-generation AI and ML solutions.

This role involves designing and implementing data pipelines, developing interactive dashboards, and integrating AI-driven components into security workflows.

• Develop and maintain SQL queries, data tables, and schemas to support cybersecurity analytics.
• Create and manage data pipelines across data warehouses and lakes.
• Develop interactive dashboards and reporting tools using Tableau or equivalent.
• Integrate LLM APIs via LangChain and leverage cloud AI services to enhance security workflows.
• Design and manage vector databases to support search and retrieval tasks.
• Apply prompt engineering techniques to optimize LLM performance for cybersecurity use cases.
• Collaborate with cross-functional teams to deliver secure, scalable, and production-ready AI/ML solutions.
• Support CI/CD pipelines and Git workflows for continuous testing and deployment.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related fields.
• Minimum 2 years' experience in data engineering or related role.

We are seeking a highly skilled professional to join our global team as a data engineer. Our company excels at combining business and technology expertise, allowing us to provide long-term value to our clients' businesses.

This role involves integrating with client teams and adapting to their specific work arrangements for successful project delivery. The placement of this role may be contractual and depends on your skillset, interview performance, and the client project you are assigned to.

• Business acumen and technical skills will drive success in this position.
• Adaptability is crucial in this fast-paced environment.

You will have the opportunity to expand your knowledge and grow professionally. Your contributions will be valued and recognized within the organization.

Job Title: Data Engineer

Description: We are seeking a skilled Data Engineer to design, build, and maintain efficient data pipelines. The ideal candidate will have hands-on experience in data collection, storage management, and visualization.

Key Responsibilities:

• Design and implement scalable data pipelines for efficient data processing.
• Better data quality, consistency, and integrity throughout the collection process.
• Optimize pipelines for performance, reliability, and security.

About this Role:

This is an excellent opportunity for a motivated professional to join our organization and make a significant impact on our data-driven decision-making processes.

Requirements:

• 1-2 years of experience in a Data Analyst or Data Engineer role.
• Proven ability to work independently with limited guidance, while collaborating effectively with multiple stakeholders.
• Experience designing, building, and maintaining batch and real-time data pipelines.
• Skilled in using data visualization tools (Tableau / Tableau Cloud preferred).

Benefits:

• A competitive salary and benefits package.
• The opportunity to work with a talented team of professionals.
• A dynamic and supportive work environment.