Sr. Data Engineer / Data Migration Specialist
Remote Position
NTD Software
Elevate your team with our expertise. Crafting digital solutions for startups to enterprises worldwide. Contact us!
Our client is currently undergoing a transition from the Lucernex database hosted on Google Cloud Platform (GCP) to an Azure-based environment using Databricks. We are seeking a skilled Data Migration Specialist to support this critical migration effort. The role will focus on data extraction, transformation, and loading (ETL) across different data platforms, ensuring smooth and reliable migration processes while maintaining data quality. If you have expertise in data ingestion, integration, migration, and cloud-based environments, we'd love to hear from you..
Requirements
- Strong experience in data migration, specifically in moving data across platforms (GCP to Azure).
- Expertise in handling ETL processes, particularly using tools like Altova MapForce.
- Experience working with databases such as SQL Server.
- Familiarity with cloud-based platforms, especially GCP and Azure.
- Knowledge of DevOps tools like Bitbucket and Jenkins for CI/CD processes.
- Ability to work with various data formats (CSV, screenshots, etc.) and create data mappings between systems.
- Strong problem-solving skills with an emphasis on data quality and integrity.
- Experience in environment management and administering cloud platforms.
- Excellent communication skills to collaborate with clients on data mapping and migration requirements.
Responsibilities
- Data Ingestion: Extract data from various source platforms and systems.
- Integration: Combine and transform data from multiple sources to ensure consistency and usability.
- Data Quality: Ensure the accuracy, completeness, and reliability of the data throughout the migration process.
- Migration: Facilitate the movement of data to the destination storage, ensuring proper handling and processing.
- Testing: Validate that the processed data meets business requirements and is fit for purpose.
- Environment Management: Administer the platforms and tools, ensuring the smooth operation of the migration process and maintaining efficient workflows.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Category:
Engineering Jobs
Tags: Azure Bitbucket CI/CD CSV Databricks Data quality DevOps ETL GCP Google Cloud Jenkins SQL Testing
Region:
Remote/Anywhere
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
BI Developer jobsSr. Data Engineer jobsData Engineer II jobsBusiness Intelligence Analyst jobsPrincipal Data Engineer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsData Science Manager jobsData Manager jobsPrincipal Software Engineer jobsData Science Intern jobsBusiness Data Analyst jobsJunior Data Analyst jobsData Analyst Intern jobsSoftware Engineer II jobsData Specialist jobsSr. Data Scientist jobsLead Data Analyst jobsDevOps Engineer jobsResearch Scientist jobsStaff Software Engineer jobsAI/ML Engineer jobsData Engineer III jobsSenior Backend Engineer jobsBI Analyst jobs
Git jobsAirflow jobsOpen Source jobsEconomics jobsLinux jobsKafka jobsComputer Vision jobsJavaScript jobsGoogle Cloud jobsMLOps jobsNoSQL jobsKPIs jobsTerraform jobsData Warehousing jobsPhysics jobsRDBMS jobsPostgreSQL jobsScikit-learn jobsBanking jobsHadoop jobsScala jobsGitHub jobsData warehouse jobsStreaming jobsPandas jobs
R&D jobsClassification jobsBigQuery jobsOracle jobsDistributed Systems jobsCX jobsPySpark jobsdbt jobsScrum jobsReact jobsLooker jobsRAG jobsMicroservices jobsJira jobsRobotics jobsRedshift jobsSAS jobsIndustrial jobsData Mining jobsPrompt engineering jobsNumPy jobsGPT jobsELT jobsMySQL jobsData strategy jobs