Data Engineer (Scala/PostgreSQL/Kafka/Spark)
Chris Travers <[email protected]> Fri, 23 Aug 2019 10:56:28 +0200
| Newsgroups | gmane.comp.db.postgresql.jobs |
|---|---|
| Message-ID | <CAN-RpxDX0V1pannQRJ3CLfQ5R4epNcbcv0eJxyeh8omZmQig-A@mail.gmail.com> |
--000000000000dfccbe0590c4fc5a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable As an introductory note on this particular application, our new architecture for this product has been the subject of multiple conference talks in the PostgreSQL community, and leverages PostgreSQL as a query engine which queries parquet files (via our own foreign data wrapper) generated by Spark jobs, allowing us to scale storage and query engines separately. We would certainly give preference to candidates who have strong PostgreSQL experience in this regard as well as the Scala/Spark side= . Data Engineer Berlin Adjust is a fast-growing mobile marketing analytics company. We build business intelligence for mobile apps, placing a high premium on scientific statistics, hand-in-glove UX, and lean, pragmatic product iteration. We enable marketers to understand how their marketing campaigns are performing= . We are looking for a *Data Engineer* to join our Development Team in Berlin= . *What we offer you:* - A competitive salary - Flexibility in work schedule - Relocation assistance - An international team with strong focus on transparency - Regular team gatherings and company retreats - An opportunity to do office exchanges in other satellite locations - Additional perks such as Friday team lunches and free access to our company gym More details about our company culture and perks can be found on our career= s page <https://www.unbotify.com/about/>. *Your role:* As Data Engineer you will be responsible for ensuring rapid ingestion of data into our retargeting platform, called AudienceBuilder. You will help us to scale from tens of TBs into multiple PBs of data while ensuring maintainable, performant code. You will build and maintain queryable very large data sets using Spark, Parquet, and PostgreSQL which includes ingesting and compacting data in order to save space and improve query performance. When a new feature is developed, you will translate business requirements into technical specifications, and implement those. You will analyze performance bottlenecks and optimize accordingly. *Your tasks:* - Design review and ensure scalability to hundreds of thousands of events ingested per second - Implement, test, and document components to ingest data to support new features - Provide escalation support for the data ingestion portion of the platform - Work closely with our operations team to develop maintenance and operational procedures as well as escalation paths *Your profile:* - Experience in development in a distributed environment - Solid knowledge of Scala and/or Java - Experience with Spark - Flink and PostgreSQL experience is a plus *Interested? Let=E2=80=99s Talk!* *Application link: https://grnh.se/46638ad02 <https://grnh.se/46638ad02> * --=20 Best Regards, Chris Travers Head of Database Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbr=C3=BCcker Stra=C3=9Fe 37a, 10405 Berlin --000000000000dfccbe0590c4fc5a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div id=3D"gmail-header"= style=3D"padding:40px 0px 20px;margin:0px">As an introductory note on this= particular application, our new architecture for this product has been the= subject of multiple conference talks in the PostgreSQL community, and leve= rages PostgreSQL as a query engine which queries parquet files (via our own= foreign data wrapper) generated by Spark jobs, allowing us to scale storag= e and query engines separately.=C2=A0 We would certainly give preference to= candidates who have strong PostgreSQL experience in this regard as well as= the Scala/Spark side.<div style=3D"color:rgb(59,69,71);font-family:"M= aven Pro",Avenir-Light,Arial,Helvetica,sans-serif;font-size:14px"><br>= </div><h1 class=3D"gmail-app-title" style=3D"color:rgb(59,69,71);font-famil= y:"Maven Pro",Avenir-Medium,Arial,Helvetica,sans-serif;font-size:= 22px;margin:0px;text-align:center;padding:0px;font-weight:inherit">Data Eng= ineer</h1><div class=3D"gmail-location" style=3D"color:rgb(117,117,117);fon= t-family:"Maven Pro",Avenir-Light,Arial,Helvetica,sans-serif;font= -size:14px;margin:5px 0px 0px;text-align:center;padding:0px">Berlin</div></= div><div id=3D"gmail-content" class=3D"gmail-" style=3D"line-height:20px;ma= rgin-bottom:40px;color:rgb(59,69,71);font-family:"Maven Pro",Aven= ir-Light,Arial,Helvetica,sans-serif;font-size:14px"><p style=3D"margin:0px = 0px 15px">Adjust is a fast-growing mobile marketing analytics company. We b= uild business intelligence for mobile apps, placing a high premium on scien= tific statistics, hand-in-glove UX, and lean, pragmatic product iteration. = We enable marketers to understand how their marketing campaigns are perform= ing.</p><p style=3D"margin:0px 0px 15px">We are looking for a=C2=A0<strong = style=3D"font-family:"Maven Pro",Avenir-Medium,Arial,Helvetica,sa= ns-serif;line-height:15px">Data Engineer</strong>=C2=A0to join our Developm= ent Team in Berlin.</p><p style=3D"margin:0px 0px 15px"><strong style=3D"fo= nt-family:"Maven Pro",Avenir-Medium,Arial,Helvetica,sans-serif;li= ne-height:15px">What we offer you:</strong>=C2=A0=C2=A0</p><p style=3D"marg= in:0px 0px 15px">- A competitive salary</p><p style=3D"margin:0px 0px 15px"= >- Flexibility in work schedule</p><p style=3D"margin:0px 0px 15px">- Reloc= ation assistance</p><p style=3D"margin:0px 0px 15px">- An international tea= m with strong focus on transparency</p><p style=3D"margin:0px 0px 15px">- R= egular team gatherings and company retreats</p><p style=3D"margin:0px 0px 1= 5px">- An opportunity to do office exchanges in other satellite locations</= p><p style=3D"margin:0px 0px 15px">- Additional perks such as Friday team l= unches and free access to our company gym</p><p style=3D"margin:0px 0px 15p= x">More details about our company culture and perks can be found on our=C2= =A0<a href=3D"https://www.unbotify.com/about/" style=3D"text-decoration:non= e;color:rgb(41,117,202)">careers page</a>.</p><p style=3D"margin:0px 0px 15= px">=C2=A0</p><p style=3D"margin:0px 0px 15px"><strong style=3D"font-family= :"Maven Pro",Avenir-Medium,Arial,Helvetica,sans-serif;line-height= :15px">Your role:</strong></p><p style=3D"margin:0px 0px 15px">As Data Engi= neer you will be responsible for ensuring rapid ingestion of data into our = retargeting platform, called AudienceBuilder. You will help us to scale fro= m tens of TBs into multiple PBs of data while ensuring maintainable, perfor= mant code.=C2=A0You will build and maintain queryable very large data sets = using Spark, Parquet, and PostgreSQL which includes ingesting and compactin= g data in order to save space and improve query performance.=C2=A0When a ne= w feature is developed, you will translate business requirements into techn= ical specifications, and implement those. You will analyze performance bott= lenecks and optimize accordingly.</p><p style=3D"margin:0px 0px 15px">=C2= =A0</p><p style=3D"margin:0px 0px 15px"><strong style=3D"font-family:"= Maven Pro",Avenir-Medium,Arial,Helvetica,sans-serif;line-height:15px">= Your tasks:</strong></p><p style=3D"margin:0px 0px 15px">- Design review an= d ensure scalability to hundreds of thousands of events ingested per second= </p><p style=3D"margin:0px 0px 15px">- Implement, test, and document compon= ents to ingest data to support new features</p><p style=3D"margin:0px 0px 1= 5px">- Provide escalation support for the data ingestion portion of the pla= tform</p><p style=3D"margin:0px 0px 15px">- Work closely with our operation= s team to develop maintenance and operational procedures as well as escalat= ion paths</p><p style=3D"margin:0px 0px 15px">=C2=A0</p><p style=3D"margin:= 0px 0px 15px"><strong style=3D"font-family:"Maven Pro",Avenir-Med= ium,Arial,Helvetica,sans-serif;line-height:15px">Your profile:</strong></p>= <p style=3D"margin:0px 0px 15px">- Experience in development in a distribut= ed environment</p><p style=3D"margin:0px 0px 15px">- Solid knowledge of Sca= la and/or Java</p><p style=3D"margin:0px 0px 15px">- Experience with Spark<= /p><p style=3D"margin:0px 0px 15px">- Flink and PostgreSQL experience is a = plus</p><p style=3D"margin:0px 0px 15px">=C2=A0</p><p style=3D"margin:0px 0= px 15px"><strong style=3D"font-family:"Maven Pro",Avenir-Medium,A= rial,Helvetica,sans-serif;line-height:15px">Interested? Let=E2=80=99s Talk!= </strong></p><p style=3D"margin:0px 0px 15px"><strong style=3D"font-family:= "Maven Pro",Avenir-Medium,Arial,Helvetica,sans-serif;line-height:= 15px">Application link:=C2=A0<a href=3D"https://grnh.se/46638ad02">https://= grnh.se/46638ad02</a>=C2=A0</strong></p></div><div><br></div>-- <br><div di= r=3D"ltr" class=3D"gmail_signature"><div dir=3D"ltr"><div><div dir=3D"ltr">= <div><div dir=3D"ltr"><div dir=3D"ltr">Best Regards,<div>Chris Travers</div= ><div>Head of Database</div><div><br></div><div><div style=3D"margin:0cm 0c= m 0.0001pt"><font size=3D"2" color=3D"#000000"><span style=3D"font-family:A= rial">Tel:=C2=A0</span></font>+49 162 9037 210=C2=A0<span style=3D"color:rg= b(0,0,0);font-family:Arial">| Skype: einhverfr |=C2=A0</span><span style=3D= "color:rgb(0,0,0);font-family:Arial"><a href=3D"http://www.adjust.com/" sty= le=3D"color:rgb(17,85,204)" target=3D"_blank">www.adjust.com</a>=C2=A0</spa= n></div><div style=3D"margin:0cm 0cm 0.0001pt"><font color=3D"#000000">Saar= br=C3=BCcker Stra=C3=9Fe 37a, 10405 Berlin<font size=3D"2"><span style=3D"f= ont-family:Arial"><br></span></font></font></div></div><div><font color=3D"= #000000"><br></font></div></div></div></div></div></div></div></div></div><= /div></div> --000000000000dfccbe0590c4fc5a--