Sr. Data Engineer / Data Migration Specialist
Remote Position
NTD Software
Elevate your team with our expertise. Crafting digital solutions for startups to enterprises worldwide. Contact us!
Our client is currently undergoing a transition from the Lucernex database hosted on Google Cloud Platform (GCP) to an Azure-based environment using Databricks. We are seeking a skilled Data Migration Specialist to support this critical migration effort. The role will focus on data extraction, transformation, and loading (ETL) across different data platforms, ensuring smooth and reliable migration processes while maintaining data quality. If you have expertise in data ingestion, integration, migration, and cloud-based environments, we'd love to hear from you..
Requirements
- Strong experience in data migration, specifically in moving data across platforms (GCP to Azure).
- Expertise in handling ETL processes, particularly using tools like Altova MapForce.
- Experience working with databases such as SQL Server.
- Familiarity with cloud-based platforms, especially GCP and Azure.
- Knowledge of DevOps tools like Bitbucket and Jenkins for CI/CD processes.
- Ability to work with various data formats (CSV, screenshots, etc.) and create data mappings between systems.
- Strong problem-solving skills with an emphasis on data quality and integrity.
- Experience in environment management and administering cloud platforms.
- Excellent communication skills to collaborate with clients on data mapping and migration requirements.
Responsibilities
- Data Ingestion: Extract data from various source platforms and systems.
- Integration: Combine and transform data from multiple sources to ensure consistency and usability.
- Data Quality: Ensure the accuracy, completeness, and reliability of the data throughout the migration process.
- Migration: Facilitate the movement of data to the destination storage, ensuring proper handling and processing.
- Testing: Validate that the processed data meets business requirements and is fit for purpose.
- Environment Management: Administer the platforms and tools, ensuring the smooth operation of the migration process and maintaining efficient workflows.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Category:
Engineering Jobs
Tags: Azure Bitbucket CI/CD CSV Databricks Data quality DevOps ETL GCP Google Cloud Jenkins SQL Testing
Region:
Remote/Anywhere
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Senior AI Engineer jobsData Engineer II jobsSr. Data Engineer jobsBI Developer jobsPrincipal Data Engineer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsData Manager jobsData Science Manager jobsData Science Intern jobsPrincipal Software Engineer jobsBusiness Data Analyst jobsJunior Data Analyst jobsData Specialist jobsResearch Scientist jobsData Analyst Intern jobsSoftware Engineer II jobsLead Data Analyst jobsDevOps Engineer jobsSr. Data Scientist jobsData Engineer III jobsAI/ML Engineer jobsJunior Data Engineer jobsStaff Software Engineer jobsData Engineering Manager jobs
Git jobsEconomics jobsLinux jobsOpen Source jobsKafka jobsAirflow jobsHadoop jobsPhysics jobsNoSQL jobsData Warehousing jobsGoogle Cloud jobsKPIs jobsJavaScript jobsRDBMS jobsMLOps jobsComputer Vision jobsScala jobsBanking jobsPostgreSQL jobsScikit-learn jobsData warehouse jobsTerraform jobsClassification jobsGitHub jobsR&D jobs
Streaming jobsOracle jobsPandas jobsPySpark jobsSAS jobsCX jobsScrum jobsBigQuery jobsDistributed Systems jobsData Mining jobsJira jobsLooker jobsReact jobsMicroservices jobsRAG jobsdbt jobsRobotics jobsRedshift jobsIndustrial jobsUnstructured data jobsJenkins jobsMySQL jobsNumPy jobsE-commerce jobsData strategy jobs