Data Engineer
A USD 70K-80K Mid-level Contract Full Time
Tasks
- Build ETL/ELT workflows
- Build streaming data pipelines
- Conduct code reviews and promote engineering best practices
- Design data warehouses data lakes and lakehouses
- Design scalable batch and real time data pipelines
- Develop optimized SQL queries
- Document data architecture and pipeline designs
- Ensure data security governance access control encryption compliance
- Implement cloud data platforms
- Implement data quality validation monitoring observability
- Implement incremental processing and CDC
- Mentor data engineers and provide technical leadership
- Optimize data pipelines and Spark jobs
- Orchestrate data pipelines
- Perform data pipeline performance tuning
- Process large datasets with distributed systems
- Set up CI/CD for data workflows
- Troubleshoot production data issues and perform root cause analysis
- Write unit, integration, and data quality tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | Access Control | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure Synapse | Bitbucket | CCPA | CI/CD | Cassandra | Cloud Storage | Clustering | DBT | Data Catalog | Data Factory | Data Governance | Data Lake | Data Lake Storage | Data Lineage | Data Quality | Data Warehouse | Databricks | Dataflow | Dataproc | Dimensional Modeling | Docker | DynamoDB | ELT | ETL | Encryption | Event Hubs | GDPR | Git | GitHub | GitLab | Google BigQuery | Google Cloud | Google Cloud Storage | HIPAA | Informatica | Kafka | Kinesis | Kubernetes | Lakehouse | MongoDB | MySQL | Observability | Oracle | Partitioning | PostgreSQL | Pub/Sub | PySpark | Python | Role-Based Access | Role-Based Access Control | SQL | SQL Server | SSIS | Schema management | Slowly Changing Dimensions | Snowflake | Snowflake Schema | Star Schema | Talend | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Senior AI Engineer - Finance USD 140K-203KAWS | Azure | CI/CD | Cloud platform | Data EngineeringDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeWashington, DC, US6h ago
-
Senior Specialist Solutions Architect - Agentic AI, AGS Specialist Solutions Architects USD 153K-207KAI Governance | AWS | Agent evaluation | Amazon AgentCore | Amazon BedrockSenior-level Full TimeSeattle, Washington, USA11h ago
-
Solution Engineer, Enterprise Acquisition USD 165K-216KData Warehousing | Generative AI | Language Models | Large Language Models | Machine LearningSenior-level Full TimeUS-NY-New York11h ago
-
Data Infrastructure Engineer (Query Engine) USD 185K-250KApache Spark | Avro | C++ | Caching | Concurrency401k | Dental insurance | Flexible work hours | Health insurance | Immigration assistanceMid-level Full TimeSan Mateo, CA11h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Privacy | EncryptionDiscretionary paid time off | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R12h ago
-
Active Learning | Auto-labeling | Computer Vision | Confidence Scores | Data BalancingBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, … R12h ago
-
Consultant – Compliance Data Science & AI USD 98K-122KAWS | Anthropic | Azure | Data Pipelines | Data Visualization401k match | Cell phone stipend | Employee assistance program | FSA | HSAMid-level Full TimeSan Francisco, CA, United States12h ago
-
Associate Consultant, Generative AI USD 84K-122KAWS | Azure | CI/CD | Cloud platform | Compliance401k match | Employee assistance program | Flexible spending account | Health savings account | Paid parental leaveMid-level Full TimeSan Francisco, CA, United States12h ago
-
Consultant- Marketing Data Science & AI USD 95K-116KAWS | Azure | Cloud platform | Data Engineering | Data Visualization401k match | Generous PTO | Medical, dental, and vision | Paid parental leaveMid-level Full TimeNew York, NY, United States12h ago
-
Associate Consultant, Generative AI USD 80K-110KAWS | Azure | CI/CD | Docker | Evaluation401k matching | Cell phone stipend | College Savings Assistance | Dental insurance | Employee assistance programMid-level Full TimeNew York, NY, United States12h ago
-
AI & Data Engineer USD 140K-188KAEM Sites | AWS | AWS Bedrock | Adobe Experience | Adobe Experience CloudSenior-level Full TimeLawrence Township, New Jersey, United States13h ago
-
Senior Systems Engineer, Database USD 170K-250KACID | AWS Lambda | Algorithms | Amazon S3 | Amazon Web ServicesIn-office workSenior-level Full TimeVienna, VA, USA13h ago
-
Senior AI/ML Architect, Applied Field Engineering USD 165K-216KAWS | Apache Airflow | Apache Spark | As-a-Service | Cloud platformSenior-level Full TimeUS-NY-New York13h ago
-
Solution Engineer USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data meshTravelSenior-level Full TimeUS-OH-Remote R14h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R14h ago
-
Senior Analytics Engineer USD 141K-176KAWS Glue | Amazon Athena | Apache Hive | Apache Spark | CI/CDGenerous time off | Healthcare | Occasional travel for in person meetings | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R15h ago
-
Senior Machine Learning Engineer USD 153K-210KBacktesting | Calibration | Class imbalance | Data Validation | Deep learningSenior-level Full TimeEl Segundo15h ago
-
Senior-level Full TimeEl Segundo15h ago
-
Senior-level Full TimeEl Segundo15h ago
-
Mid-level Full TimePalo Alto15h ago
-
Senior Embedded Software Engineer USD 136K-204KBash | C# | C++ | Computer Architecture | Computer NetworkingActive Top Secret clearance | Onsite work | TS SCI clearance supportSenior-level Full TimeHerndon, Virginia15h ago
-
Sr AI Engineer USD 84K-105KAudio signal processing | C Embedded Systems | C embedded | C# | Data Preprocessing100% onsite | ADND Insurance | Accrued Paid Vacation | Company paid life insurance | Dental insuranceSenior-level Full TimeColumbia, MARYLAND, United States15h ago
-
Data Engineer USD 100K-160KAirflow | Amazon Redshift | Apache Spark | Azure | Azure Data401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractCoppell, Texas, USA15h ago
-
Senior Data Engineer USD 155K-180KApache Spark | Azure | Bash | CI/CD | DatabricksCareer development | Mentorship | Training programsSenior-level Contract Full TimeNew York15h ago
-
Senior Software Engineer (Forward Deployed) USD 180K-264KAWS | Automation | Data Contracts | Data Governance | Data QualityHybrid work | On-call support | Travel opportunitiesSenior-level Full TimeLondon - Hybrid; New York - … R16h ago