Databricks Data Engineer Job at Smart IT Frame LLC, New York, NY

WVltalpleUFJUDRXYitibXMwMjI2bzErSmc9PQ==
  • Smart IT Frame LLC
  • New York, NY

Job Description

Job Title: Databricks Data Engineer

Location: NYC, NY (Hybrid)

Work Type: Full Time

Job Description:-

· This role will be part of the Data Strategy team spanning across the client Capital Markets and securities teams, Americas Division’s broker-dealer and swap-dealer entities.

· This role will be involved in the active development of the data platform in close coordination with the team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.

· The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.

· The implementation of this strategic platform on client’s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.

Qualifications and Skills

· 10+ years of experience in software development using Python, PySpark and its frameworks.

· Proven experience as a Data Engineer with experience in Azure cloud.

· Experience implementing solutions using -

o Azure cloud services

o Azure Data Factory

o Azure Lake Gen 2

o Azure Databases

o Azure Data Fabric

o API Gateway management

o Azure Functions

· Well versed with Azure Databricks

· Strong SQL skills with RDMS or noSQL databases

· Experience with developing API’s using FastAPI or similar frameworks in Python

· Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes

· Good understanding of ETL/ELT processes

· Experience in financial services industry, financial instruments, asset classes and market data are a plus.

Job Tags

Full time,

Similar Jobs

Premier Medical Staffing Services

Travel Nurse RN - CVICU - $2,254 per week Job at Premier Medical Staffing Services

 ...Medical Staffing Services is seeking a travel nurse RN CVICU for a travel nursing job in...  ...Discipline: RN ~ Duration: 13 weeks ~36 hours per week ~ Shift: 12 hours, days ~...  ...of the healthcare landscape, we offer per-diem, contract and direct hire placements to support... 

L3Harris Technologies

Information Security Systems Engineer 1 Job at L3Harris Technologies

Job Title: Spec, Information Security Systems Engineer Job Code: 21025 Job Location: Rochester, NY or Columbia, MD Job Schedule: 9/80: Employees work 9 out of every 14 days - totaling 80 hours worked - and have every other Friday off Job Description: The Information Security... 

Edgewood Center for Rehab and Healthcare

Weekend 12-hour Registered Nurse RN Job at Edgewood Center for Rehab and Healthcare

 ...Bonus Bring your friends along and get rewarded!7a-7p or 7p-7a every weekend (Staurday and Sunday) Weekend pay plus evening and night-shift differentials for increased earning potential. A positive and collaborative workplace where your skills are valued, and... 

Diakon Logistics

Independent Contractor - Delivery & Installation Job at Diakon Logistics

Let us provide the truck!Diakon Logistics is a leading Home Delivery Service provider expanding and growing our business in the MI area and are looking for enterprising and motivated Independent Contract Carriers for delivery and set up of general household goods in our...

LewisGale Medical Center

Monitor Tech Job at LewisGale Medical Center

 ...Healthcare, we are committed to caring for patients with purpose and integrity. We care like family! Jump-start your career as a(an) Monitor Tech today with LewisGale Medical Center. Benefits LewisGale Medical Center, offers a total rewards package that supports the...