Online Data Engineer
STORE SUPPORT CENTER, ATLANTA - 9090, United States
USD 95K-170K (estimate) Entry-level Full Time
Tasks
- Build ETL pipelines for structured and unstructured data
- Build test and maintain database pipeline architectures
- Configure orchestration and automate CI CD
- Create data collection frameworks
- Create data validation methods
- Define metadata and rules for ETL processes
- Design and develop data transformation algorithms
- Develop APIs to retrieve data
- Develop and host in house enterprise data solutions
- Engineer batch and streaming data pipelines
- Prepare and manipulate data using Hadoop or MapReduce
- Translate business requirements into data solutions
- Use predictive and prescriptive analytics models for insights
- Write analytical SQL queries
- Write automation scripts and support pipelines in production
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Airflow | Apache Spark | Batch Processing | CI/CD | Data Lakes | Data Pipelines | Data Validation | Data Warehousing | ETL | Google BigQuery | Hadoop | JavaScript | MapReduce | Metadata Management | PySpark | Python | React | SQL | Streaming Data
Education
Roles
Related jobs
-
API | Agile | Data Modeling | Data Quality | Data TransformationCI Polygraph sponsorship within first year | Obtain A Plus within 6 months | Obtain Network Plus within 6 months | Obtain Security Plus within 6 months | TS SCI clearance sponsorshipMid-level Full TimeSpringfield, VA; Falls Church, VA; Falls …9h ago
-
Intelligent Systems Engineer II USD 98K-166KAPIs | AWS Lambda | AWS S3 | Amazon Web Services | Artificial Intelligence401k match | Community service day | Dental insurance | Flexible spending accounts | Life insuranceMid-level Full TimeWest Chester, OH, United States9h ago
-
Intelligent Systems Engineer II USD 98K-166KAPI Gateway | APIs | AWS | Artificial Intelligence | Automated testing401k match | Community service day | Flexible spending accounts | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeWest Chester, OH, United States9h ago
-
Bash | Command Line | Command-line Interface | Data Tiering | Dell PowerScaleContract-to-hire | Hybrid work | Unlimited growthSenior-level Full TimeNashville, TN9h ago
-
Prompt Engineer USD 100K-150KA/B | A/B Testing | AI Agents | API Development | Agent systemsCareer advancement path | Coffee | Continuous feedback | Cross-functional collaboration | Growth opportunitiesEntry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R10h ago
-
Senior Backend Engineer USD 160K-220KAWS | Asynchronous processing | CI/CD | Cloud infrastructure | Debugging401k access | Career growth | Flexible PTO | Health, dental, vision coverage | Paid mealsSenior-level Full TimeSan Francisco, CA, US11h ago
-
AI Architect USD 111K-139KAI Search | Azure | Azure AI | Azure AI Search | Azure DevOps401k match | Employee discounts | Financial wellness planning | Great Place to Work certified | Health, dental and vision coverageSenior-level Full TimeCincinnati, Ohio, USA13h ago
-
AI Architect USD 148K-185KAI Search | Authentication | Azure | Azure AI | Azure AI Search401k match | Employee discounts | Financial wellness planning | Great Place to Work certification | Health, dental and vision coverageSenior-level Full TimeTampa, Florida, USA13h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML model development | Artificial Intelligence | C++ | CI/CDSenior-level Full TimeAustin, TX, USA14h ago
-
Imaging Machine Learning Engineer USD 132K-189K3A Tuning | Algorithm Development | Benchmarking | C++ | CalibrationMid-level Full TimeMountain View, CA, USA14h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KC++ | Code review | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL16h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …1d ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …1d ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …1d ago
-
Senior Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C Programming | C programming language | C#401k employer match | Cell phone reimbursement | Dinner provided twice weekly | EV charging | Flexible PTOSenior-level Full TimeEl Segundo, California, United States1d ago
-
Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | Cell phone reimbursement | EV charging | Flexible PTO | HSA employer matchEntry-level Full TimeEl Segundo, California, United States1d ago
-
Sr. Lead Software Engineer - Data Engineer USD 170K-186KAWS | Agentic AI | Agile | Apache Iceberg | Best practicesSenior-level Full TimeJersey City, NJ, United States1d ago
-
.NET | AI Foundry | Agile | Angular | App Service401 K | Employee stock ownership plan | Free hot lunches | Health, dental, vision insurance | Long-term disability insuranceSenior-level Full TimeLakeland, FL, Florida, 333 E Lemon …1d ago
-
Senior Data Analytics Consultant USD 113K-188KData Integrity | Data Security | Data Visualization | Data pipeline | ETL401k retirement plan | Adoption Assistance | Dental insurance | Employee referral program | Flexible spending accountSenior-level Full TimeClient Office: Huntsville, AL, United States1d ago
-
Senior Data Engineer USD 28KAgentic AI | Agile | Apache Iceberg | CI/CD | Confluence401k plan | Commuter benefits | Disability benefits | Life insurance | Paid time offSenior-level Full Time142019-NC-300 South Brevard, Charlotte, United States1d ago
-
API Development | Accessibility | Apache JMeter | Apache Kafka | Apache Spark401k match | Adoption Assistance | Healthcare benefits | Life insurance | Long-term disabilitySenior-level Full TimeIrving, TX, United States R1d ago
-
Senior UX Developer (NIH Data Lakehouse Support) USD 110K-149KAWS | Azure | CI/CD | CSS | DatabricksPublic trust required clearance process | Remote workSenior-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago
-
Digital Electrical Engineer – Embedded Controls USD 90K-130KADC | C# | C++ | Command Response Protocols | DAC401k plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNatick, MA ,01760, MA1d ago
-
Machine Learning Engineer II USD 111K-231KApache Kafka | Apache Spark | Big Data | Cloud platform | Data pipeline401k | Backup childcare | Education stipends | Health insurance | Hybrid workMid-level Full TimeUS - United States of America R1d ago