142 Data Pipelines jobs in Singapore
Mastering Large-Scale Data Pipelines
Posted today
Job Viewed
Job Description
About Data Engineering
Do you want to leverage your technical expertise in building, maintaining and enhancing data pipelines? Do you have experience with designing scalable architectures for high-traffic systems?
Job Description:- Design, develop, and maintain large-scale data engineering systems that meet the needs of our clients.
- Collaborate with cross-functional teams to identify opportunities for process improvements and implement changes.
- Develop data visualization tools and reports to help stakeholders make informed business decisions.
- Work with data scientists to design and implement machine learning models that drive business growth.
- Bachelor's degree in Computer Science or related field.
- 4+ years of experience in software development with a focus on data engineering.
- Proficiency in languages such as Python, Java, and Scala.
- Experience with cloud-based technologies like AWS or Azure.
- Strong understanding of database concepts and ability to work with complex data structures.
As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data engineering systems. You will collaborate with cross-functional teams to identify opportunities for process improvements and implement changes. You will also develop data visualization tools and reports to help stakeholders make informed business decisions.
In addition, you will work with data scientists to design and implement machine learning models that drive business growth. If you have experience with designing scalable architectures for high-traffic systems, we encourage you to apply.
Data Architecture Specialist
Posted today
Job Viewed
Job Description
We are seeking a highly skilled and experienced data architecture specialist to design, build, and optimize end-to-end data architecture for social service platforms. This role involves leading efforts in data modeling, pipeline development, API integration, data security, and cross-agency data synchronization, ensuring secure and efficient access to critical citizen information.
Key Responsibilities:
1. Data Architecture & Pipeline Development
- Design and implement scalable and reusable data models to support social service integration.
- Build and manage ETL/ELT pipelines for legacy system migration and real-time data synchronization across agencies.
- Develop and maintain batch and streaming data pipelines for cross-agency data sharing.
- Implement data validation frameworks and monitoring systems to ensure high data quality.
2. Integration Development & API Management
- Design and develop RESTful APIs and system integrations for solutions like case management software.
- Develop and maintain detailed API documentation, including interface contracts and change logs.
- Ensure API performance, security, availability, and scalability through structured testing and monitoring.
3. Data Security & Compliance
- Enforce data protection measures, including field-level encryption, role-based access controls, and secure data transfer.
- Ensure compliance with regulatory frameworks.
- Maintain audit trails, implement data masking, and classify sensitive data appropriately.
- Monitor and enforce data policies across environments.
4. Performance Optimization & Monitoring
- Tune query performance and batch processing to support near real-time analytics.
- Monitor and optimize real-time data synchronization processes.
- Develop and maintain performance dashboards to track pipeline health and system metrics.
- Ensure high system reliability, uptime, and service level objectives (SLOs) are met.
5. Cross-Team Collaboration
- Collaborate closely with business analysts, solution architects, DevOps, and frontend/backend developers.
- Participate in Agile ceremonies, including sprint planning, backlog grooming, and retrospectives.
- Conduct code reviews, engage in pair programming, and foster technical excellence within the team.
- Provide expertise and support on data integration and architecture.
6. Quality Assurance & Documentation
- Maintain clear and up-to-date technical documentation, including system design and data flow diagrams.
- Develop automated test cases to validate data transformations and integration logic.
- Conduct end-to-end data accuracy validation across source and destination systems.
- Create troubleshooting playbooks and resolution procedures to support operational teams.
Requirements:
- Bachelor's or Master's degree in Computer Science, Information Systems, or related discipline.
- 7+ years of experience in data architecture, data engineering, or system integration roles.
- Proficient in ETL tools, SQL, data modeling, and real-time stream processing frameworks.
- Strong experience with API development and integration standards.
- Familiarity with systems integration, services, and compliance requirements.
- Solid understanding of data security, access control, and compliance frameworks.
- Experience in cloud platforms, CI/CD pipelines, and monitoring tools.
- Excellent communication and documentation skills.
Data Architecture Specialist
Posted today
Job Viewed
Job Description
We are seeking a skilled professional to fill the role of Data Engineer/Software Developer.
The successful candidate will be responsible for designing and implementing data integration pipelines and asynchronous data events using event-driven architecture to consolidate data from various sources and systems.
- Collaborate with highly skilled Software Engineers and Data Engineers in deploying and delivering software products.
- Taking ownership of key software components development.
- Design, develop, and maintain scalable data models and schemas using best practices.
- Develop integration connectors for multiple sources and systems.
- Data transformation and processing: clean, normalize, and aggregate data.
- Strong knowledge of data manipulation languages like SQL necessary to build and maintain complex queries and data pipelines.
- Implement event-driven processing pipelines using frameworks like Solace Pubsub, Apache Kafka, MQTT, AMQP.
- Bachelor's/Master's degree in Computer Science / Engineering / Industrial Engineering or related field.
- Proficiency in at least one object-oriented language; Java skills are desirable.
- Deep understanding of event-driven architecture, data producers and consumers.
- Knowledge on data analytics pipeline, data lakehouse & warehouse concept.
- Familiarity with relational and non-relational databases.
- Excellent communication, collaboration, and problem-solving skills.
- Work collaboratively as part of a team.
- Design and implement data pipelines.
- Develop integration connectors.
- Maintain data quality.
- Collaborate with cross-functional teams.
As a Data Engineer/Software Developer, you will have the opportunity to work on challenging projects and contribute to the success of the company. We offer a competitive compensation package and opportunities for career growth and professional development.
VP, Data Architecture & Strategy
Posted 20 days ago
Job Viewed
Job Description
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Charterhouse Asia
Recruiting Top Talent in Technology, Quant Dev, & Digital l Career Coach lA leading financial services firm is looking to hire a VP of Data Strategy & Architecture to join their dynamic data function. This leadership role will play a key part in designing robust data models that power core banking functions, regulatory reporting, risk analytics and broader strategic initiatives.
This is an exciting opportunity for a seasoned data professional who thrives in fast-paced, complex environments and is passionate about building scalable data architecture that drives meaningful business outcomes.
Responsibilities:
- Partner with business and technology stakeholders to gather data requirements related to banking products, customer transactions, reporting, and analytics.
- Design and maintain logical and physical data models that align with key business use cases.
- Convert complex business requirements into scalable, efficient data structures that support both operations and analytics.
- Lead the development and continuous improvement of data marts, data warehouses, and integration layers.
- Collaborate with engineering teams to ensure optimal deployment and performance of physical data models.
- Align data architecture with governance, quality, and metadata standards.
- Produce thorough documentation, including data dictionaries, data flow diagrams, and architecture designs to support regulatory, audit, and business needs.
- Contribute to data lineage, metadata, and data quality initiatives to enhance trust in enterprise data.
Requirements:
- Degree in Computer Science, Information Systems, Data Science, or related field (Master’s preferred).
- 10+ years of experience in data architecture, modeling, or data management, ideally within the financial services or banking sector.
- Solid understanding of data governance principles (e.g. DAMA-DMBOK).
- Proven expertise in building data models for banking, risk, compliance, and finance domains.
- Skilled in data modeling tools such as Erwin, PowerDesigner, or similar platforms.
- Strong SQL capabilities with hands-on experience working with large-scale financial data sets.
- Deep understanding of relational and dimensional modeling, as well as data warehousing and integration strategies.
- Familiarity with APAC financial regulatory frameworks is a plus.
- Strong interpersonal and communication skills, with the ability to engage and align with both technical and business stakeholders.
For a confidential discussion, please contact Jackie Panopio at +65 6950 0369 or via email at
Seniority level- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Information Technology
- Industries Financial Services, Data Infrastructure and Analytics, and IT System Data Services
Referrals increase your chances of interviewing at Charterhouse Asia by 2x
Get notified about new Vice President of Architecture jobs in Singapore, Singapore .
SVP - Applications Development Technology Senior Lead (Hybrid) SVP - Applications Development Delivery Lead - Flexcube (Hybrid) VP - Applications Development Senior Manager (VisionPLUS/Mainframe) - Hybrid VP - Application Development Senior Manager (Credit Cards Domain) - Hybrid VP - Application Development Lead Analyst (eTrading/Front Office Trading) - Hybrid Trading Application Support and Development Engineer, Associate/AVP AVP - Applications Development Programmer Analyst (Mainframe) - Hybrid AVP : Applications Development Programmer Analyst (Mainframe) - Hybrid AVP - Applications Development Senior Programmer Analyst (VisionPLUS/Mainframe) - Hybrid AVP - Applications Development Senior Programmer Analyst (Java) - Hybrid VP/AVP, End User Collaborative Service (Engineering), Future Ready Technology, Group Technology Assistant Director - Zero Trust Architecture (Cyber Security Office) Vice President, Platforms And Architecture, Information Technology SVP/VP, Data & Enterprise Architecture, Technology Risk Manager, Tech COO, Group Technology Applications Support Sr Manager - VP - SINGAPORE Assistant Vice President, Production Services Specialist (Event and Incident Management), Application Production Services and Engineering Assistant Vice President, Production Operations Specialist (Event and Incident Management), Application Production Services and Engineering Assistant Vice President, Production Operations Specialist (Event and Incident Management), Application Production Services and EngineeringWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrVP, Data Architecture & Strategy
Posted today
Job Viewed
Job Description
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Charterhouse Asia
Recruiting Top Talent in Technology, Quant Dev, & Digital l Career Coach l
A leading financial services firm is looking to hire a VP of Data Strategy & Architecture to join their dynamic data function. This leadership role will play a key part in designing robust data models that power core banking functions, regulatory reporting, risk analytics and broader strategic initiatives.
This is an exciting opportunity for a seasoned data professional who thrives in fast-paced, complex environments and is passionate about building scalable data architecture that drives meaningful business outcomes.
Responsibilities:
- Partner with business and technology stakeholders to gather data requirements related to banking products, customer transactions, reporting, and analytics.
- Design and maintain logical and physical data models that align with key business use cases.
- Convert complex business requirements into scalable, efficient data structures that support both operations and analytics.
- Lead the development and continuous improvement of data marts, data warehouses, and integration layers.
- Collaborate with engineering teams to ensure optimal deployment and performance of physical data models.
- Align data architecture with governance, quality, and metadata standards.
- Produce thorough documentation, including data dictionaries, data flow diagrams, and architecture designs to support regulatory, audit, and business needs.
- Contribute to data lineage, metadata, and data quality initiatives to enhance trust in enterprise data.
Requirements:
- Degree in Computer Science, Information Systems, Data Science, or related field (Master’s preferred).
- 10+ years of experience in data architecture, modeling, or data management, ideally within the financial services or banking sector.
- Solid understanding of data governance principles (e.g. DAMA-DMBOK).
- Proven expertise in building data models for banking, risk, compliance, and finance domains.
- Skilled in data modeling tools such as Erwin, PowerDesigner, or similar platforms.
- Strong SQL capabilities with hands-on experience working with large-scale financial data sets.
- Deep understanding of relational and dimensional modeling, as well as data warehousing and integration strategies.
- Familiarity with APAC financial regulatory frameworks is a plus.
- Strong interpersonal and communication skills, with the ability to engage and align with both technical and business stakeholders.
For a confidential discussion, please contact Jackie Panopio at +65 6950 0369 or via email at
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Full-time
Job function
Job function
Information TechnologyIndustries
Financial Services, Data Infrastructure and Analytics, and IT System Data Services
Referrals increase your chances of interviewing at Charterhouse Asia by 2x
Get notified about new Vice President of Architecture jobs in Singapore, Singapore .
SVP - Applications Development Technology Senior Lead (Hybrid)
SVP - Applications Development Delivery Lead - Flexcube (Hybrid)
VP - Applications Development Senior Manager (VisionPLUS/Mainframe) - Hybrid
VP - Application Development Senior Manager (Credit Cards Domain) - Hybrid
VP - Application Development Lead Analyst (eTrading/Front Office Trading) - Hybrid
Trading Application Support and Development Engineer, Associate/AVP
AVP - Applications Development Programmer Analyst (Mainframe) - Hybrid
AVP : Applications Development Programmer Analyst (Mainframe) - Hybrid
AVP - Applications Development Senior Programmer Analyst (VisionPLUS/Mainframe) - Hybrid
AVP - Applications Development Senior Programmer Analyst (Java) - Hybrid
VP/AVP, End User Collaborative Service (Engineering), Future Ready Technology, Group Technology
Assistant Director - Zero Trust Architecture (Cyber Security Office)
Vice President, Platforms And Architecture, Information Technology
SVP/VP, Data & Enterprise Architecture, Technology Risk Manager, Tech COO, Group Technology
Applications Support Sr Manager - VP - SINGAPORE
Assistant Vice President, Production Services Specialist (Event and Incident Management), Application Production Services and Engineering
Assistant Vice President, Production Operations Specialist (Event and Incident Management), Application Production Services and Engineering
Assistant Vice President, Production Operations Specialist (Event and Incident Management), Application Production Services and Engineering
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrChief Data Architecture Strategist
Posted today
Job Viewed
Job Description
We are seeking a highly skilled Chief Data Architecture Strategist to join our team. As a Senior Data Platform Solution Architect, you will play a crucial role in developing and maintaining Azure Data Architecture within a banking environment, ensuring compliance with data-related policies and standards.
Your primary responsibilities will include designing and implementing data solutions using Databricks, including data pipelines, ETL processes, and data lakes, while analyzing system integration challenges and collaborating with data engineers and IT teams to address technical issues and support infrastructure needs.
You will also be responsible for implementing data security and privacy protection measures, and developing strategies for data acquisition, archive recovery, and database implementation.
In addition, you will collaborate with data governance teams to ensure data solutions comply with banking regulations.
Lastly, you will monitor system performance, troubleshoot issues, and maintain up-to-date knowledge of the Azure platform, Databricks, and industry best practices.
Required Skills and Qualifications- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or a related discipline.
- Extensive experience with Azure services, including Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB, and Databricks.
- Proven expertise in designing and implementing solutions using Databricks, including Spark, Delta Lake, and MLflow.
- Proven experience in data architecture and management, preferably within a cloud environment.
- Banking experience or a strong understanding of banking regulations is preferred.
This role offers an opportunity to work with a cutting-edge technology stack and contribute to the development of innovative data solutions.
About UsWe are a leading organization in the field of data management and architecture, committed to delivering high-quality solutions to our clients.
Chief Data Architecture Officer
Posted today
Job Viewed
Job Description
We are seeking an experienced Senior Enterprise Data Architect to lead the design and delivery of our Market Data Services.
You will play a critical role in building a robust Enterprise Data Management (EDM) system supporting functions across Treasury, Risk, Finance, Wholesale, and Retail Banking globally.
Key Responsibilities:- Design end-to-end architecture for enterprise-level Market Data Services.
- Develop and maintain architecture blueprints, standards, and frameworks for data sourcing, quality checks, transformation, and distribution.
- Strong hands-on experience with NeoXam DataHub or similar EDM platforms.
- Proven ability to design and implement data models and establish golden sources of truth.
- Experience managing enterprise-level data distribution to downstream systems.
- High exposure and strong value to your career profile.
- Opportunity to work on a strategic initiative under an optional regulatory regime.
- Proven leadership in market data architecture and implementation.
- Able to act as Subject Matter Expert (SME) in market and referential data.
- Comfortable working across front-to-back office user groups and managing senior stakeholders.
Be The First To Know
About the latest Data pipelines Jobs in Singapore !
Senior Data Architecture Specialist
Posted today
Job Viewed
Job Description
We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, analytics, and leadership responsibilities.
Key Responsibilities:- Design, develop, and manage scalable and secure data pipelines across multiple sources.
- Architect and maintain enterprise data infrastructure, ensuring efficient data flow to data lakes/warehouses.
- Execute and maintain ETL processes, including data validation and quality assurance.
- Drive data governance and security compliance in alignment with company policies.
- Collaborate with cross-functional teams to deliver analytics and reporting solutions.
- Utilize Azure Data Services and Power BI to develop, publish, and manage reports and dashboards.
- Ensure high performance and availability of analytics platforms.
- Manage project deliverables for all data analytics initiatives.
- Define and document data standards, policies, and best practices.
- Ensure the scalability and reliability of data systems to meet growing business demands.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of hands-on experience in data engineering and analytics, with leadership responsibilities.
- Strong programming skills in Python, Java, or Scala.
- Proficient in SQL, and experienced with both relational and NoSQL databases.
- Solid understanding of data modeling, data warehousing, and database management.
- Experience working with big data tools like Hadoop, Spark, and Kafka.
- Proven experience with Azure cloud platforms and services.
- Familiarity with ETL tools, data quality management, and data governance frameworks.
- Strong project management and stakeholder coordination skills.
This role offers a unique opportunity to work on complex data engineering projects and contribute to the growth and success of our organization. We offer a competitive salary, comprehensive benefits package, and opportunities for professional development and advancement.
How to Apply:If you are a motivated and experienced Data Engineer looking for a new challenge, please submit your application along with your resume and cover letter.
Data Strategy & Architecture Manager
Posted 1 day ago
Job Viewed
Job Description
This individual will be responsible for designing logical data models, building data marts, and aligning enterprise data architecture with business needs—especially across complex banking and financial domains. The role requires close collaboration with both business and technical teams to ensure data assets are effectively structured to support robust analytics and strategic decision-making.
Key Responsibilities- Work closely with business stakeholders and system teams to gather data requirements across areas such as banking products, transactions, customer data, regulatory reporting, and analytics.
- Design, maintain, and evolve logical and physical data models that support financial operations, risk, compliance, and performance reporting.
- Translate business use cases into normalized and de-normalized data structures, optimized for both operational and analytical purposes.
- Lead the design and enhancement of data marts, integration layers, and enterprise data warehouse components.
- Collaborate with engineering teams to deploy and optimize data models for performance and scalability with large-scale financial datasets.
- Ensure alignment of data models with enterprise data governance, metadata standards, and data quality frameworks.
- Create and maintain documentation including data dictionaries, lineage diagrams, and architectural blueprints to support transparency, compliance, and business understanding.
- Contribute to initiatives related to data lineage, metadata management, and trust in enterprise data assets.
- Bachelor’s degree in Computer Science, Information Systems, Data Science, or a related field; a Master’s degree is preferred.
- Minimum 10 years of experience in data architecture, data modeling, or enterprise data management—preferably within the banking or financial services industry.
- Foundational understanding of data governance principles and frameworks (e.g., DAMA-DMBOK).
- Strong expertise in developing logical and physical data models across banking, compliance, risk, and analytics domains.
- Proficiency in data modeling tools such as Erwin, PowerDesigner, or similar.
- Advanced SQL skills and experience working with large, complex financial data environments.
- Strong grasp of relational and dimensional modeling, data warehousing principles, and data integration best practices.
- Familiarity with regulatory requirements within the Asia-Pacific region is an advantage.
- Excellent communication and collaboration skills to engage with stakeholders across business and technology functions.
Data Integration Specialist
Posted today
Job Viewed
Job Description
Job Summary:
We are seeking a highly skilled Data Integration Specialist to join our team. This role will involve designing, developing and maintaining ETL processes for extracting, transforming and loading data from multiple sources into target systems.
:
- Develop and maintain ETL pipelines using Informatica, Talend, SSIS or other ETL tools.
- Work closely with business analysts and data architects to translate business requirements into technical solutions.
- Write and optimize SQL queries for complex data transformations and validations.
- Conduct unit testing, system testing and integration testing of ETL workflows to ensure data accuracy and completeness.
- Create and maintain technical documentation including data flow diagrams, mapping documents and transformation rules.
- Identify and resolve performance bottlenecks in ETL processes.
- Collaborate with QA teams to prepare and execute ETL test cases, track defects and verify fixes.
- Bachelor's degree in Computer Science, Information Technology or related field.
- 5+ years of experience in ETL development using tools like Informatica, Talend, SSIS or Pentaho.
- Strong SQL skills for data manipulation, validation and performance tuning.
- Experience in ETL testing including data reconciliation and regression testing.
- Good understanding of data warehousing concepts, dimensional modeling and ETL best practices.
- Familiarity with defect tracking tools e.g JIRA HP ALM.
- Experience with cloud-based ETL platforms e.g AWS Glue Azure Data Factory Google Dataflow Snowflake.
- Exposure to automation testing tools for ETL validation e.g QuerySurge Python based scripts.
- Knowledge of big data tools Hadoop Spark is a plus.
- Technical Documentation
- Factory
- Big Data
- Pipelines
- Unit Testing
- Hadoop
- Informatica
- ETL
- Data Integration
- Information Technology
- Test Cases
- SQL
- Performance Tuning
- SSIS
- Data Warehousing
- Business Requirements