IBM Netezza Data Migration Specialist

Job Description:

We are looking for an experienced IBM Netezza Data Migration Specialist to lead a migration project from IBM Netezza to Amazon Redshift on AWS. This is a 6-month remote contract, focusing on assessing the existing network, planning and executing data migration, validating ETL processes, and conducting business validation. The ideal candidate will have hands-on expertise in IBM Netezza, AWS Database Migration Service (DMS), Amazon S3, AWS Key Management Service (KMS), Amazon Redshift, and a strong understanding of DataStage ETL processes.

Required Qualifications:

• Experience: 5 to 8+ years of data migration and ETL experience, with a focus on IBM Netezza and AWS environments.
• Technical Expertise:
  • Proficiency with IBM Netezza, AWS services (DMS, S3, KMS, CloudWatch, Redshift), and DataStage ETL.
  • Strong background in data transformation, migration, and validation processes.
• Skills:
  • Exceptional analytical and problem-solving skills.
  • Excellent communication and collaboration abilities for working with remote teams.
• Preferred: AWS certifications and prior experience with IBM Netezza-to-AWS migrations.

Key Responsibilities:

Network Setup and Migration Planning

• Assess the current network configuration and IBM Netezza connectivity to AWS Cloud.
• Analyze IBM Netezza and DataStage (ETL) workloads to design detailed migration plans.
• Set up necessary infrastructure within the AWS account, including:
  • AWS Database Migration Service (DMS)
  • Amazon S3 for data staging
  • AWS KMS keys for data security
  • Amazon Redshift cluster, configured with AWS CloudWatch for performance metrics and alerts.

Data Migration and Technical Validation

• Oversee and support the export of IBM Netezza data (approximately 1.2 terabytes) to Amazon S3, then load into Amazon Redshift.
• Develop data transformation logic, such as format adjustments and column filtering.
• Assist in the technical validation of migrated data and workload accuracy to ensure reliability.

ETL Job Migration (Lift and Shift)

• Set up DataStage infrastructure within the AWS cloud environment.
• Migrate and adjust existing DataStage ETL jobs, updating sample code as needed for AWS compatibility.
• Configure connectivity for parallel data writing to AWS cloud data warehouses, specifically Amazon Redshift.

Out-of-Sync Data Migration and Business Validation

• Migrate any out-of-sync data that was not captured during initial export, ensuring anonymization as required.
• Conduct a business validation assessment with customer stakeholders to verify that the migrated ETL jobs meet expected performance metrics.
• Complete migration by repointing ETL jobs to write data to the newly provisioned Amazon Redshift cluster (Cutover).