Data Engineer Consultant II
USA - IL (Remote), United States
R
USD 70K-121K Entry-level Full Time
Tasks
- Build lakehouse data processing workloads
- Build streaming data pipelines
- Collaborate with analytics engineers BI developers and data scientists
- Collaborate with security and governance teams for access controls
- Design batch data pipelines
- Develop ETL/ELT workflows
- Handle schema drift
- Implement CI/CD pipelines for data workloads
- Implement data modeling and transformation logic
- Implement data quality validation monitoring and reconciliation
- Implement reusable data engineering frameworks and libraries
- Manage and evolve data schemas
- Monitor data pipelines and troubleshoot failures
- Optimize Spark jobs performance and cost
- Participate in Agile sprint planning and design reviews
- Transform raw data into analytics-ready datasets
Perks/Benefits
Skills/Tech-stack
Apache Spark | CI/CD | Data Governance | Data Modeling | Data Quality | Distributed Computing | ELT | ETL | Infrastructure as Code | Lakehouse | Microsoft Fabric | Monitoring | OneLake | Python | SQL | Schema management | Version control | “as-code”
Education
N/A
Roles
Related jobs
-
Machine Learning Engineer USD 100K-140K3GPP | Adaptive modulation | Anomaly Detection | Beamforming | C#Background check clearance | Drug Test Clearance | Hybrid schedule | Onsite days Mondays Wednesdays ThursdaysMid-level Full TimeLos Angeles CA R14h ago
-
Sr. Data Governance Engineer USD 149K-205KAsset Management | CCPA | Data Asset | Data Asset Management | Data Catalog401k match | Disability insurance | Employee assistance program | Generous paid time off | Health insuranceSenior-level Full TimeUtah | Hybrid R15h ago
-
Customer Success AI Architect USD 120K-165KAPI Integration | Artificial Intelligence | Automation | Data Governance | Data Modeling401k | Daily catered lunches | Dental insurance | Employee recognition programs | Holiday partiesSenior-level Full TimeRemote US R16h ago
-
AI Intern, Data Engineering & Agent Workflows USD 62K-90KAirflow | BigQuery | Claude API | DBT | DatabricksMentorship | Professional development | Remote workEntry-level InternshipUnited States (Remote) R17h ago
-
Senior Finance Analytics Engineer, AI Native USD 103K-192KAirflow | CI/CD | Confluence | Cube | DBT401k match | Disability insurance | Employee assistance program | Equipment and tools reimbursement | Flexible PTOSenior-level Full TimeRemote, USA R18h ago
-
Senior Marketing Data Engineer - Remote USD 130K-240KAdobe Analytics | Adobe Experience | Adobe Experience Platform | Alteryx | CDP401k matching | Flexible time off | Flexible work environment | Medical/Dental/Vision insurance | Paid HolidaysSenior-level Full TimeUnited States, United States , United … R18h ago
-
Principal Data Engineer USD 160K-200KAWS | AWS Snowflake | Agile | Automated testing | Azure401k | Dental insurance | Discounts | Medical insurance | Paid leaveExecutive-level Full TimeNew York, NEW YORK, United States R19h ago
-
Senior Machine Learning Platform Engineer USD 160K-210KAmazon SageMaker | Automated retraining | C++ | CI/CD | Cloud PubSub401k match | Annual performance reviews | Company equipment provided | Company subsidized medical dental and vision | Disability benefitsSenior-level Full TimeAtlanta, GA preferred, Remote R19h ago
-
Data Engineer USD 124K-166KAPI Security | AWS | AWS Cloud | AWS Cloud Security | Amazon Kinesis401k retirement plan | Conference support | Dental & vision insurance | Disability insurance | Federal HolidaysSenior-level Full TimeUnited States - Remote R19h ago
-
Senior Data Analyst USD 121K-310KAlation | Amazon Redshift | Anomaly Detection | DBT | Data Catalog401k with company match | Employee assistance program | Learning opportunities via LinkedIn Learning and OReilly | Medical, dental, and vision insurance | Mental health supportSenior-level Full TimeRemote, United States R19h ago
-
Staff AI Engineer USD 260K-280KAPI Design | AWS | Agentic Workflows | Distributed Systems | DockerFlexible-hybrid work | On site work in San Francisco officeSenior-level Full TimeStrava SF R20h ago
-
Senior-level Full TimeUnited States R20h ago
-
Sr Machine Learning Engineer, AI Research USD 185K-215KComputer Vision | Feature Engineering | Hyperparameter Tuning | Kubeflow | Language Models401k | Dental insurance | Fertility treatment benefit | Health insurance | Life insuranceSenior-level Full TimeRemote - United States R21h ago
-
Senior AI Engineer USD 200K-230KAWS | AWS Lambda | Agent systems | Amazon Bedrock | Amazon SageMakerSenior-level Full TimeRemote - US R22h ago
-
Database Engineer USD 175K-190KChange Data Capture | Data Capture | Data pipeline | Database Design | Database performance401k match | Basic life insurance | Dental insurance | Flexible PTO | Flexible spending accountsSenior-level Full TimeRemote R22h ago
-
Lead AI/ML Software Engineer USD 180K-230KAI/ML | API Integration | Agentic Workflows | Apache Flink | Architecture401k with company match | Education and training benefits | Fully covered healthcare dental and vision | PTO flexibility | Paid HolidaysSenior-level Full TimeRemote; McLean, VA; Colorado Springs, CO; … R22h ago
-
Machine Learning Software Developer USD 146K-222KAgentic AI | C++ | Control Systems | Cybersecurity | Data collection401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R23h ago
-
Senior Data Engineer - Cybersecurity USD 99K-192KAPI Integration | BigQuery | Cloud Functions | Cloud Run | Cloud SchedulerEmployee resource groups | Flexible family care days | Medical, dental & vision coverage | Paid Holidays | Paid parental leaveSenior-level Full TimeUnited States R23h ago
-
Principal Data Engineer USD 170K-170KAWS | Airflow | Apache Spark | Azure | CI/CD401k matching | Access to Perks at Work program | EAP | EAP health advocacy program | Education budgetSenior-level Full TimeAtlanta, GA R1d ago
-
Principal Software Engineer (AI/ML Architect-Engineer) USD 163K-270KAWS | Adversarial Networks | CI/CD | Diffusion Models | Generative AISenior-level Full TimeSeattle,WA,United States R1d ago
-
Claims Data Engineer USD 90K-150KData Automation | Data Ingestion | Data Monitoring | Data Pipelines | Data PreparationBenefits | Diverse work environment | Ethical work environment | Growth opportunities | Remote workSenior-level Full TimeMaryland, USA R1d ago
-
Mid-level Full TimeUnited States R1d ago
-
Senior Data Engineers USD 123K-215KAnsible | Cassandra | Couchbase | Data Modeling | Data QualityCareer development and training | Company Matched Retirement Savings Plan | Confidential counseling | Financial coaching | Free medical dental vision life insurance disability benefitsSenior-level Full TimeNew York, NY, United States R1d ago
-
Senior Software Engineer Artificial Intelligence USD 134K-165KAsynchronous processing | Authentication | Authorization | Automated testing | CI/CD401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R1d ago
-
Analytics Engineer USD 164K-229KAirflow | Apache Spark | Data Governance | Data Modeling | Data Visualization401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago