Online Data Engineer
STORE SUPPORT CENTER, ATLANTA - 9090, United States
USD 95K-170K (estimate) Entry-level Full Time
Tasks
- Build and maintain data warehouses and data lakes
- Build batch and streaming pipelines
- Build data pipeline infrastructure
- Build, test, and maintain database pipelines
- Capture ETL metadata and rules
- Configure orchestration and automated CI CD
- Create data collection frameworks for structured and unstructured data
- Develop APIs for data retrieval
- Develop ETL jobs and pipelines
- Develop data analysis tools
- Develop data validation methods
- Engineer and automate data flow pipelines
- Extract, transform, load data from multiple sources
- Monitor test and validate enterprise solutions
- Optimize pipeline runtime and reduce storage cost
- Stitch and enrich raw data
- Translate business requirements into data solutions
- Write Hadoop MapReduce data processing
- Write analytical SQL queries
- Write automation scripts
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | CI/CD | Cloud Dataflow | ETL | Google BigQuery | Google Cloud | Google Cloud Dataflow | Hadoop | MapReduce | PySpark | Python | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML model development | Artificial Intelligence | C++ | CI/CDSenior-level Full TimeAustin, TX, USA8h ago
-
Imaging Machine Learning Engineer USD 132K-189K3A Tuning | Algorithm Development | Benchmarking | C++ | CalibrationMid-level Full TimeMountain View, CA, USA8h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KC++ | Code review | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Senior Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C Programming | C programming language | C#401k employer match | Cell phone reimbursement | Dinner provided twice weekly | EV charging | Flexible PTOSenior-level Full TimeEl Segundo, California, United States19h ago
-
Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | Cell phone reimbursement | EV charging | Flexible PTO | HSA employer matchEntry-level Full TimeEl Segundo, California, United States19h ago
-
ME00670-Database Engineer 3 USD 180K-240KBash | Cloud Computing | Data Guard | Data Modeling | Database AdministrationDental insurance | Group medical plan | Life insurance | Paid Holidays | Paid time offMid-level Full TimeAnnapolis Junction, MD23h ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Bitbucket | Atlassian Confluence | Atlassian Jira | Bare Metal | C++401k match | Career development | Employee assistance program | Low cost dental | Low cost visionSenior-level Full TimeMarietta, GA R1d ago
-
Principal Embedded Software Engineer USD 160K-200KBare Metal | Bitbucket | C++ | Cameo | Confluence401k employer match | Career development | Employee assistance program | Low cost dental | Low cost visionSenior-level Full TimeMarietta, GA R1d ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R1d ago
-
Lead Embedded Software Engineer USD 211K-286KAerospace Standards | Agile | Bitbucket | C++ | CentOSSenior-level Full TimePhoenix, AZ1d ago
-
Lead Data Engineer USD 176K-200KAWS | Apache Airflow | Data Modeling | Data Processing | Data ReliabilityBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States1d ago
-
Airflow | Decision Trees | Deep learning | Docker | EnsemblesSenior-level Full TimeSan Francisco, California, United States1d ago
-
💎 Computational Materials Scientist 💎 USD 90K-140KAWS EC2 | Artificial Intelligence | Bash | Enterprise Linux | GPU ComputingFree food and snacks | Health care plan | Life insurance | Long-term disability | Paid time offMid-level Full TimeWalnut Creek, California, United States R1d ago
-
Principal Machine Learning Engineer, ML Platform USD 212K-287KAgent workflows | Amazon SageMaker | Artifact management | Autoscaling | Batch inferenceCharity donation match | Coaching | Company offsites | Dental coverage | Flexible working hoursSenior-level Full TimeRemote (United States) R1d ago
-
Mid-level Full TimeNew Jersey, New Jersey, United States1d ago
-
Sr. Data Engineer USD 61K-94KApache Flink | Apache Kafka | Apache NiFi | Apache Spark | Cassandra401k match | Accidental death and dismemberment insurance | Bonus plan | Commuter benefits | Flexible spending accountsSenior-level Full TimeCordova, TN, United States1d ago
-
Senior-level Full TimeAustin, TX1d ago
-
Full Stack Gen AI Engineer USD 128K-197KAWS Bedrock | AWS Fargate | Amazon ECS | Amazon Web Services | CI/CDSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Machine Learning Engineer USD 129K-220KC++ | Computer Vision | Data Curation | Dataset Preparation | Deep learning401k | Flexible working hours | Free Coffee, Drinks & Snacks | Health insurance | Life insuranceEntry-level Full TimeArlington, Virginia1d ago
-
Machine Learning Engineer USD 129K-190KComputer Vision | Deep learning | Language Processing | Machine Learning | Multi-object Tracking401k | Flexible working hours | Free coffee | Free drinks | Free snacksMid-level Full TimeClifton Park, New York1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago