Java Spark Developer-Software Engineer II
Jersey City, New Jersey, United States
USD 80K-134K Mid-level Full Time
Tasks
- Design and build batch data pipelines
- Design and build real-time streaming data pipelines
- Implement and maintain fault tolerant ETL ELT workflows
- Integrate pipelines with relational databases and NoSQL stores
- Optimize and debug Apache Spark performance tuning
- Participate in agile ceremonies and code reviews
- Support deployment pipelines with CI/CD
- Use Git for version control
- Write SQL queries and integrate with databases
- Write and test Java code with SOLID principles
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | CI/CD | Concurrency | Distributed Systems | Docker | ELT | ETL | Event Driven | Event-driven architecture | Git | JUnit | Java | Java 8 | Kubernetes | Microservices | Object Oriented Concurrency | Object-Oriented | Object-oriented programming | RDD | SOLID | SQL | Scrum | Spark DataFrames | Spark Datasets | Spark SQL
Roles
Data Engineer | Developer | Engineer | Java | Java Developer | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States7h ago
-
Anomaly Detection | Confidence scoring | Confusion matrix | Data Annotation | Data DriftSenior-level ContractCalabasas, United States10h ago
-
AI Software Engineer USD 170K-253KAgent Development | Auth | CI/CD | Canary Releases | Evaluation FrameworksEmployee stock purchase plan | Health insurance | Leave options | Life insurance | Paid time offSenior-level Full TimeHome - United States Tier 2 …10h ago
-
Lead Applied AI Engineer II USD 118K-243K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …11h ago
-
Analytics and Insights Engineer III USD 113K-188KETL | Microsoft Office | Python | SQLSecret clearanceSenior-level Full TimeArlington/Rosslyn, Virginia, United States11h ago
-
Big Data Engineer USD 80KApache Spark | Distributed File System | File System | Hadoop | Hadoop Distributed File SystemMid-level Full TimeUS-FL-Tampa12h ago
-
Data Science Team Leader USD 165K-165KCI/CD | Cloud platform | Docker | Google BigQuery | Google CloudSenior-level Full TimeDenver, Colorado, United States13h ago
-
Production Engineer (University Grad) USD 177K-200KAI | C++ | CDN | Java | LAMPWork authorization supportSenior-level Full TimeBellevue, WA | Menlo Park, CA13h ago
-
Senior-level Full TimeSunnyvale, CA | Remote, US | … R13h ago
-
Senior-level Full TimeRemote, US | Bellevue, WA | … R13h ago
-
Principal Engineer, GDC Storage, Google Cloud USD 307K-428KCloud Computing | Cloud Identity | Cloud Monitoring | Cloud identity and security | Cloud loggingBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA14h ago
-
Staff Software Engineer, AI/ML, Google Public Sector USD 207K-301KC++ | Cloud Native | Cloud Object Storage | Cloud-native infrastructure | Data IngestionSenior-level Full TimeReston, VA, USA14h ago
-
Technical Lead, Machine Learning, Google Play USD 207K-301KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | ExperimentationSenior-level Full TimeMountain View, CA, USA14h ago
-
Software Engineer III, AI/ML, Google Security Operations USD 147K-211KC++ | Cloud Platforms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA14h ago
-
C++ | Data Structures | Data Structures and Algorithms | Generative AI | GoSenior-level Full TimeNew York, NY, USA14h ago
-
Customer Engineer, Databases, Google Public Sector USD 152K-222KAnalytic workload | Cloud Native | Cloud Native Architecture | Cloud platform | Data MigrationSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA14h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R20h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R21h ago
-
Senior Data Engineer, Platform USD 119K-149KAWS DMS | Access Control | Airflow | Amazon Web Services | CI/CDSenior-level Full TimeRemote - US, United States R1d ago
-
Full Stack AI Engineer USD 140K-170KAWS | Agent workflows | Anthropic | Azure | CI/CD401k matching | Birthday off | Employee assistance program | Medical/Dental/Vision insurance | Paid parental leaveSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Pig | Apache SparkCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Backend AI-Forward Data Engineer USD 100K-125KAWS | Airflow | Anomaly Detection | Automated testing | Azure DataDental insurance | Disability insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R1d ago