514 Big Data Architect jobs in Singapore

Job Summary:

• This is a challenging opportunity for an experienced data professional to join our organization and drive the design and development of big data platforms. As a Technical Architect, you will play a key role in shaping the technical direction of our company and ensuring that our data architecture meets the evolving needs of our business.

About the Role:

1. Data Architecture: Define reusable design patterns for data movement, validation, load, and extraction processes to enable efficient data ingestion, storage, and visualization.
2. Metadata Management: Set up a metadata repository for connections, schemas, and contexts to ensure data consistency and accuracy.
3. Error/Audit Framework: Develop foundational components like error handling and audit frameworks to provide visibility into system operations and data quality.
4. Technical Leadership: Provide technical guidance to the development team in preparing design artifacts and implementing integrations to ensure seamless data flow.
5. Development Optimization: Optimize development through solution accelerators and value creators to improve productivity and efficiency.

Key Responsibilities:

• IT Solutions: Strong affinity for IT solutions and data architecture on macro and micro levels to drive business growth.
• Data Modeling: Conceptual brilliance with a track record of big data solutions, including structured and unstructured data modeling to unlock insights.
• Change Management: Sound experience in driving and delivering change to ensure a smooth transition to new systems and processes.

Required Skills and Qualifications:

• Big Data Platform: Hands-on experience in designing and developing big data platforms (GCC, AWS, Azure, etc.) to support scalable data architectures.
• Programming Skills: Hands-on programming experience in big data (Python, PySpark, Spark Scala, etc.) to develop efficient data processing pipelines.
• Cloud Services: Hands-on experience with cloud services (Kinesis, Kafka, Lambda, Databricks, etc.) to ensure secure and reliable data transfer.
• Storage Solutions: Hands-on experience with storage covering schema layout, data modeling, partitioning, RDBMS, and NoSQL databases to optimize data storage and retrieval.

Benefits:

• Data Ingestion: Expertise in understanding client business and providing solution architecture in cloud covering data ingestion, storage, and visualization to drive business outcomes.

We are looking for a skilled Data Engineer to join our team.

The ideal candidate should have experience in delivering data pipeline solutions and architecture, as well as understanding business requirements and building reliable data infrastructure using big data technologies.

• Contribute to the full data engineering lifecycle, including conceptualization, data modeling, implementation, and operational management of data systems.
• Build and maintain robust, scalable data infrastructure, including real-time and batch ETL/ELT data pipelines, using orchestration tools like Apache Airflow.
• Support the development and management of the organization's data lake and data warehouse by implementing data models and applying modern data transformation practices with tools like dbt.
• Automate data processes by integrating different systems, APIs, and third-party services to ensure smooth data flow and synchronization.
• Adhere to and help enforce best practices for data governance, quality, and lineage, while implementing monitoring and alerting to ensure system reliability.
• Collaborate with cross-functional teams to help translate business requirements into technical specifications and production-ready solutions.

• Bachelor's degree in computer science, software engineering, or related field is preferred.
• Minimum 2 years of similar experience.
• Solid understanding of software engineering principles, system architecture, and object-oriented design, with experience building applications.
• Strong proficiency in Python, including experience with data manipulation libraries (e.g., Pandas, NumPy) and frameworks for web scraping (e.g., Scrapy) or AI/ML (e.g., TensorFlow, PyTorch).
• Experience with workflow orchestration tools like Apache Airflow for managing data pipelines.
• Familiarity with data transformation tools like dbt and an understanding of modern ETL/ELT design patterns.
• Hands-on experience with any cloud platform (AWS, GCP, or Azure).
• Proficient in SQL with experience in designing and optimizing relational databases (e.g., PostgreSQL, Oracle, SQL Server).
• Experience with containerization and CI/CD.

• A competitive salary and benefits package.
• A dynamic and collaborative work environment.
• Ongoing training and professional development opportunities.

Job Description

The ideal candidate will bring deep expertise in Java, Apache Spark, and Hadoop ecosystems. They will lead the development and deployment of data ingestion, ETL/ELT pipelines, and data transformation frameworks to ensure high performance and reliability of big data systems through performance tuning and best practices.

Key responsibilities include designing and building scalable, high-performance big data solutions using distributed computing, data partitioning, and optimization techniques. The engineer will manage and monitor batch and real-time data pipelines from diverse sources including APIs, databases, and streaming platforms like Kafka.

Additionally, the engineer will apply deep knowledge of Java to build efficient, modular, and reusable codebases. They will also mentor junior engineers, participate in code reviews, and enforce engineering best practices.

Required Skills and Qualifications

7–12 years of experience in big data engineering or backend data systems

Strong hands-on programming skills in Java

Proven experience with Apache Spark, Hadoop (HDFS, YARN, MapReduce), and related tools

Benefits and Challenges

This role is critical to ensuring robust data processing and delivering clean, actionable data for business insights and advanced analytics. We are looking for a Senior Big Data Engineer who can lead our growing data engineering team.

About the Job

We are seeking a highly skilled Senior Big Data Engineer to join our team. The successful candidate will have a strong background in big data engineering and a proven track record of delivering high-quality results.

Senior Big Data Solution Architect

Apply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 15 Days Ago job requisition id R

Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of retail, medical, education, transportation and other industries, CSIG helps companies serve users in smarter ways, building a new ecosystem of intelligent industries that connect users and businesses.

• The candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements.
• Capable of recommending the core advantages and capabilities of Tencent Cloud's Big Data products and solutions to customers, overcoming obstacles to migrating customer data to the cloud, supporting the implementation of Big Data product solutions in the cloud, and solidifying Big Data product solutions.
• Thoroughly understand customers' technical issues and requirements regarding Big Data products, act as a bridge within the Big Data product team, and collaborate efficiently with industry, research and development, pre-sales, and after-sales teams to effectively solve customer problems.
• Extract core customer requirements for Big Data products and drive continuous optimization and enhancement of product capabilities.

• Bachelor's degree or above in computer science, communication, or related fields, with over five years of experience in Big Data projects. Experience in cloud computing and Big Data development is preferred.
• Familiar with the open-source Hadoop ecosystem, knowledgeable about various Big Data component architectures (including Spark, Flink, Elasticsearch, etc.), and familiar with the characteristics and issues of these components in various Big Data scenarios.
• Familiar with the characteristics of mainstream cloud computing Big Data products, especially AWS, Azure, and GCP's Big Data products. Experience as a cloud vendor Big Data architect is preferred.
• Strong communication skills, clear, logical thinking, proactive and responsible work attitude, positive and open-minded approach to work, and good teamwork abilities.
• Proficient in Chinese and English, with English proficiency for daily customer communication and support.

Diversity, Equity & Inclusion at Tencent

Diversity, equity and inclusion are important, interdependent components of our workplace. As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

Senior Big Data Solution Architect
Apply remote type Onsite locations Singapore-CapitaSky time type Full time posted on Posted 15 Days Ago job requisition id R
Business Unit
What the Role Entails
Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of retail, medical, education, transportation and other industries, CSIG helps companies serve users in smarter ways, building a new ecosystem of intelligent industries that connect users and businesses.
The candidate needs to deeply understand customers' needs and pain points regarding Big Data products and solutions and design overall Big Data product solutions tailored to customer business scenarios and technical requirements.
Capable of recommending the core advantages and capabilities of Tencent Cloud's Big Data products and solutions to customers, overcoming obstacles to migrating customer data to the cloud, supporting the implementation of Big Data product solutions in the cloud, and solidifying Big Data product solutions.
Thoroughly understand customers' technical issues and requirements regarding Big Data products, act as a bridge within the Big Data product team, and collaborate efficiently with industry, research and development, pre-sales, and after-sales teams to effectively solve customer problems.
Extract core customer requirements for Big Data products and drive continuous optimization and enhancement of product capabilities.
Who We Look For
Bachelor's degree or above in computer science, communication, or related fields, with over five years of experience in Big Data projects. Experience in cloud computing and Big Data development is preferred.
Familiar with the open-source Hadoop ecosystem, knowledgeable about various Big Data component architectures (including Spark, Flink, Elasticsearch, etc.), and familiar with the characteristics and issues of these components in various Big Data scenarios.
Familiar with the characteristics of mainstream cloud computing Big Data products, especially AWS, Azure, and GCP's Big Data products. Experience as a cloud vendor Big Data architect is preferred.
Strong communication skills, clear, logical thinking, proactive and responsible work attitude, positive and open-minded approach to work, and good teamwork abilities.
Proficient in Chinese and English, with English proficiency for daily customer communication and support.
Diversity, Equity & Inclusion at Tencent
Diversity, equity and inclusion are important, interdependent components of our workplace. As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.
Equal Employment Opportunity at Tencent
As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.
#J-18808-Ljbffr

• Manage and configure Microsoft Intune for device compliance, app deployment, and policy enforcement.
• Support and maintain Exchange Online, including mailbox management, mail flow rules, and hybrid configurations.
• Deploy and monitor Windows 365 Cloud PCs, manage user provisioning and performance.
• Implement and maintain Microsoft Defender for Endpoint and related M365 security policies.
• Use Azure Active Directory (AAD) to manage identities, roles, and Conditional Access policies.
• Automate routine administrative tasks using PowerShell and Microsoft Graph API.
• Monitor service health and performance using Azure Monitor, Log Analytics, and M365 Admin Center.
• Collaborate with the security and helpdesk teams to troubleshoot and resolve issues.

Job description:

• We are seeking a highly skilled Cloud Architect to design, implement, and maintain cloud-based systems and infrastructure. The ideal candidate will have extensive experience with cloud technologies, including AWS, Azure, or Google Cloud.
• The successful candidate will be responsible for configuring and administering cloud infrastructure components, optimizing resources across various aspects of the cloud environment, and ensuring optimal performance, scalability, and security of cloud environments.
• This role requires a strong understanding of cloud development, including Infrastructure as Code (IaC) using tools like Terraform, Terragrunt, and CloudFormation.
• Familiarity with CI/CD pipelines, containerization using Docker, and orchestration using Kubernetes is also essential.
• The successful candidate will collaborate with cross-functional teams, including sales, project management, and software development teams, to plan, design, and develop optimized cloud solutions for customers.

Requirements:

• A degree in Computer Science, Information Systems, Engineering, or equivalent.
• At least 3 years of experience working with cloud technologies.
• Hands-on experience with Linux/Unix and/or Microsoft Windows Server Administration.
• Proficiency in networking concepts, including DNS, TCP/IP, and firewalls.
• Familiarity with automation and configuration management tools.
• Strong problem-solving skills and ability to troubleshoot complex technical issues.
• Excellent communication and collaboration skills.

Benefits:

• Competitive salary and benefits package.
• Opportunities for professional growth and development.
• Collaborative and dynamic work environment.

Others:

• We offer flexible working hours and remote work options.
• Our team is passionate about innovation and customer satisfaction.
• Join us in shaping the future of cloud computing!

Job Overview:

We are seeking a Cloud Engineer to join our team and support the transition and operation of client websites/applications in Amazon Cloud.

The ideal candidate will work closely with the web and application teams to ensure seamless integration and deployment of scalable, highly available, and fault-tolerant systems on AWS.

• Key Responsibilities:

1. Deploying, managing, and operating scalable, highly available, and fault-tolerant systems on AWS
2. Migrating existing on-premises applications to AWS, including implementing and controlling data flow to and from AWS while selecting appropriate services based on compute, data, or security requirements
3. Identifying and applying AWS operational best practices, as well as estimating AWS usage costs and implementing operational cost control mechanisms

• Required Skills and Qualifications:

1. 2-3 years of hands-on experience operating AWS-based applications
2. Experience provisioning, operating, and maintaining systems running on AWS
3. Ability to identify and gather requirements to define a solution to be built and operated on AWS
4. Experience with application/data migration to AWS, scaling an application and/or its hosting environment to support increases in traffic, and proficiency in Windows and Linux