Data Quality Engineering Lead
Dearborn, MI
USD 115K-153K (estimate) Senior-level Contract Full Time
Tasks
- Automate QA processes using Python, PySpark, Java
- Coordinate defect validation with development
- Create and execute API testing scenarios
- Create and execute manual test cases in Jira
- Create test cases in TestRail
- Design and implement automation frameworks with PyTest
- Ensure quality, efficiency, and compliance
- Lead testing of dashboards and metrics
- Log defects in JIRA
- Manage code repositories, pull requests, and code merges
- Participate in daily agile stand-ups
- Stay current with testing tools and practices
- Test AI prompting tools and responses
- Test data ingestion, transformation, and aggregation in Databricks and Azure
- Update task status in JIRA
- Use SonarQube for code quality and fixing code smells
- Validate ETL rules and complex business logic
- Validate data flow, content, and business rules
- Verify data accuracy in UI and backend
- Write complex SQL queries and validate data
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | Agile methodology | Automation frameworks | Avro | Azure Databricks | Code Repository | Code repository tools | Data Aggregation | Data Pipeline Testing | Data Transformation | Data Validation | Data metrics | Data pipeline | Databricks | Development Lifecycle | ETL | JSON | Jira | Parquet | Pipeline testing | PySpark | Pytest | Python | Repository tools | SQL | Software Development Lifecycle | Software development | SonarQube
Education
Related jobs
-
Senior Manager, Data Engineering - GTM Data Enablement USD 160K-235KAttribution | Audience Segmentation | Campaign activation | Customer Data | Customer Data Platform401k retirement plan | Dental insurance | Disability insurance | Employee assistance program | Employee recognition programSenior-level Full TimeDraper, Utah, United States; San Jose, … R20h ago
-
IT Lead Data Engineer USD 138K-170KAmazon Web Services | Azure DevOps | Cloud platform | Data Engineering | Data GovernanceSenior-level Full TimeGrand Rapids, MI, United States2d ago
-
Director of Data Engineering USD 145K-250KAWS | Agile | Bash Scripting | Data Processing | Data Processing Frameworks401k | Disability insurance | Employee assistance program | Flexible paid time off | Flexible spending accountsExecutive-level Full TimeCharlotte, NC R3d ago
-
Data Engineering Lead USD 145K-164KAzure Databricks | Data Modeling | Dataframe APIs | ETL | LakehouseSenior-level Full TimeUnited States - Remote R8d ago
-
Lead Data Engineer USD 70K-140KAWS | Agile | Athena | BI tools | Data ArchitectureFlexible work arrangement | Office environmentSenior-level Full TimeEaston Ops Cols C Oh, United …8d ago
-
Senior Manager, AI and Data Scientist USD 150K-224KAI Model Deployment | AI model | AI/ML | AWS SageMaker | Data Architecture401k match | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimePrinceton, United States9d ago
-
Data Engineering Lead — Data, Cloud and AI USD 140K-195KAI | BigQuery | CI/CD | Cloud GCP | ContainerizationCollaborative culture | High-impact projects | Innovative technology environment | Mentorship opportunitiesSenior-level Full TimeNew York Metropolitan Area10d ago
-
Snowflake Data Engineer Lead USD 53K-112KAirflow | Cloud Native | Cloud-native orchestration | Data Migration | Data ModelingHealth insurance | Paid time off | Retirement plans | Training opportunitiesSenior-level Full TimeNew York, NY, US11d ago
-
Sr. Data Engineering Lead, Onsite, VP USD 120K-202KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SQLFlexible work options | Health insurance | Paid time off | Professional development opportunities | Retirement plansSenior-level Full TimeQuincy, Massachusetts, United States11d ago
-
Sr. Data Engineering Lead, Onsite, VP USD 120K-202KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseDevelopment programs | Employee networks | Flexible work arrangements | Health insurance | Paid time offSenior-level Full TimeQuincy, Massachusetts, United States11d ago
-
Principal, Data Engineer USD 126K-181KAWS | Agile | CI/CD | CloudFormation | DevOpsContinuous learning | Global team collaboration | Remote workSenior-level Full Time100 New Millennium Way, Bldg 1, …12d ago
-
B2B Data Engineering Lead USD 94K-121KAI | CI/CD | Cloud Storage | Data Architecture | Data Governance401k | Dental insurance | Disability insurance | Flexible paid time off | Life insuranceSenior-level Full TimeNew York - 150 E 42nd, …12d ago
-
Azure | CI/CD | Data Architecture | Distributed Systems | Infrastructure as CodeDental benefits | Disability coverage | Life insurance | Medical benefits | Paid time offSenior-level Full TimeMaine R14d ago
-
Azure | CI/CD | Cloud services | Data Architecture | Data Modeling401k plan | Disability coverage | Internet support | Life insurance | Medical, dental, vision benefitsSenior-level Full TimeIdaho R14d ago
-
AI | AWS | Data Engineering | Database Management | DatabricksDental insurance | Medical insurance | Paid time off | Remote work | Retirement plansSenior-level Full TimeMassachusetts R15d ago
-
Lead Data Engineer / SME USD 190K-304KAPI Development | Airflow | Cloud Platforms | Containerization | HadoopSenior-level Full TimeFort Meade, MD, United States17d ago
-
Risk Data AI/ML Engineer USD 186K-214KAirflow | DBT | Data Governance | Data Modeling | Data ObservabilityHealth insurance | Paid time off | Professional development | Remote workSenior-level Full TimeFrisco, TX17d ago
-
Director, Analytics Engineering USD 270K-330KAWS | Airflow | BigQuery | Cloud Platforms | Cloud platforms GCPDental insurance | Equity | Flexible hours | Health insurance | Mental health supportExecutive-level Full TimeNew York, NY17d ago
-
Data Architecture | Data Governance | Data Pipelines | Data Security | Data VisualizationFlexible hours | Growth opportunities | Health benefits | Inclusive team culture | Remote workSenior-level Full TimeNew Jersey R18d ago
-
Data Engineering and Development, Vice President USD 120K-217KAI model development | API Integration | Algorithms | Data Structures | Distributed SystemsEmployee assistance program | Health insurance | Paid time off | Performance bonuses | Retirement savings planExecutive-level Full TimeQuincy, Massachusetts, United States19d ago
-
AI modeling | Advanced Reasoning | Deep learning | Language Models | Large Language ModelsHealth and wellness programs | Inclusive culture | Time offSenior-level Full TimeSunnyvale, CA, United States22d ago
-
Data Engineering Lead USD 120K-160KAWS | Agile | Athena | Aurora | BatchFlexible schedule | Health insurance | Paid time off | Professional development | Referral programSenior-level Full TimeSuitland-Silver Hill, Maryland, United States24d ago