IBM Netezza to AWS Data Migration Specialist
Job Description:
We are looking for a skilled IBM Netezza to AWS Data Migration Specialist to lead a critical migration project, transitioning data and ETL jobs from IBM Netezza to Amazon Redshift within a non-production environment. This is a 6-month, remote contractual role that will involve assessing network configurations, developing detailed migration plans, migrating ETL workloads, and validating data accuracy post-migration. The ideal candidate will have extensive experience with IBM Netezza databases, AWS Database Migration Service (DMS), Amazon Redshift, and hands-on experience with DataStage (ETL) and related AWS infrastructure.
Key Responsibilities:
IBM Netezza Network Setup and Migration Planning
- Assess IBM Netezza connectivity to AWS Cloud and review network setup.
- Conduct a comprehensive analysis of Netezza and DataStage ETL workloads to establish a detailed migration plan.
- Set up essential AWS infrastructure, including:
- AWS Database Migration Service (DMS) for streamlined data migration
- Amazon S3 for staging data
- AWS Key Management Service (KMS) keys for secure data handling
- Amazon Redshift cluster with AWS CloudWatch metrics and alerts for real-time performance monitoring.
Data Migration and Technical Validation
- Assist in exporting Netezza data (1.2 TB) to Amazon S3 and transferring it to Amazon Redshift.
- Design and implement data transformation logic, such as format conversion and column filtering, to ensure data consistency.
- Support the technical validation of migrated data to verify integrity and completeness.
DataStage ETL Jobs Migration (Lift and Shift)
- Configure DataStage infrastructure within AWS to support ETL jobs.
- Migrate DataStage ETL jobs from Netezza to AWS and make necessary adjustments to sample code.
- Establish connectivity to write data in parallel to the cloud data warehouse on AWS (e.g., Amazon Redshift).
Synchronize Out-of-Sync Data and Conduct Business Validation
- Migrate any data that has not been synchronized after the initial export, ensuring anonymization if necessary.
- Perform a business validation assessment with customer stakeholders to confirm the accuracy of migrated ETL jobs.
- Complete the cutover by repointing ETL jobs to the newly provisioned Amazon Redshift cluster.
Required Qualifications:
- Experience: 5+ years in data migration and ETL, specifically with IBM Netezza and AWS environments.
- Technical Expertise:
- In-depth knowledge of IBM Netezza databases, DataStage ETL tools, and AWS services (DMS, S3, KMS, CloudWatch, Redshift).
- Strong background in data transformation, migration, and validation processes.
- Skills:
- Strong analytical and problem-solving abilities.
- Effective communication and collaboration skills to work within a remote team.
- Preferred: AWS certification(s) and experience with IBM Netezza data migration.