Hacker Newsnew | past | comments | ask | show | jobs | submit | giseir's commentslogin

Excuse me for technical illiteracy, but would that make sense to export these snapshots daily? Is there any way to consistently get the (every 24h) data from the database in S3?


Let’s say I have a database with 1TB of data. I export it daily to S3 with this Snapshot export. Does it mean I will be adding 1TB every day to my S3 storage?


Yes


Thanks, now I understand it. Then it makes sense to delete the earlier snapshot and only keep the latest one to not store redundant data.


You can also use the CDC features of AWS Data Migration Service to just get incrementals (also in parquet if preferred) rather than full snapshots.

https://aws.amazon.com/blogs/database/aws-dms-now-supports-n...


SumUp | BERLIN, Germany | ONSITE, Full-time | VISA SPONSORSHIP | https://sumup.com/careers/

We are the leading FintTech company in Europe with major offices in Berlin, Sofia, and São Paulo comprising more than 1500+ people. We started out six years ago and created a unique device to accept card payments anywhere. Beyond our original hardware, mobile and web apps, we have gone on to develop a suite of APIs and SDKs for integrating SumUp payments into other apps and services. Today, hundreds of thousands of small businesses in 32 countries around the world rely on SumUp to get paid. Join Us!

We're looking for:

* Senior Data Warehouse Developer - Python, PL/SQL, Snowflake, PostgreSQL, BigQuery, Apache Spark, Redshift - https://sumup.com/careers/positions/4376038002/

* Senior Data Engineer for Data Lake: AWS, S3, Airflow, Apache Spark EMR. - https://sumup.com/careers/positions/4370163002?gh_jid=437016...

* many other technical positions at https://sumup.com/careers/

You can apply via links or feel free to reach out directly to julia.matsai@sumup.com


SumUp | BERLIN, Germany | ONSITE, Full-time | VISA SPONSORSHIP | https://sumup.com/careers/ We are the leading FintTech company in Europe with major offices in Berlin, Sofia, and São Paulo comprising more than 1500+ people. We started out six years ago and created a unique device to accept card payments anywhere. Beyond our original hardware, mobile and web apps, we have gone on to develop a suite of APIs and SDKs for integrating SumUp payments into other apps and services. Today, hundreds of thousands of small businesses in 32 countries around the world rely on SumUp to get paid. Join Us! We're hiring for: * Senior Data Engineer - Python, Airflow, Redshift, Kafka, Apache Spark - https://sumup.com/careers/positions/4324797002/ * Data Warehouse Developer - Python, PL/SQL, PostgreSQL, BigQuery, Apache Spark, Redshift - https://sumup.com/careers/positions/4376038002/ * many other positions at https://sumup.com/careers/ You can apply via links or feel free to reach out directly to julia.matsai@sumup.com


SumUp | BERLIN, Germany | ONSITE, Full-time | VISA SPONSORSHIP | https://sumup.com/careers/ We are the leading FintTech company in Europe with major offices in Berlin, Sofia, and São Paulo comprising more than 1500+ people. We started out six years ago and created a unique device to accept card payments anywhere. Beyond our original hardware, mobile and web apps, we have gone on to develop a suite of APIs and SDKs for integrating SumUp payments into other apps and services. Today, hundreds of thousands of small businesses in 32 countries around the world rely on SumUp to get paid.

Join Us!

We're hiring for:

* Senior Data Engineer - Python, Airflow, Redshift, Kafka, Apache Spark - https://sumup.com/careers/positions/4324797002/

* Data Warehouse Developer - Python, PL/SQL, PostgreSQL, BigQuery, Apache Spark, Redshift - https://sumup.com/careers/positions/4376038002/

* many other positions at https://sumup.com/careers/

You can apply via links or feel free to reach out directly to julia.matsai@sumup.com


what are the salary ranges for those positions?


UML Diagrams are actually quite useful, sometimes you just need a structured way to reason about software.


There are two types of useful UML:

The first is what I call whiteboard UML - it looks like any UML course except you draw it on a whiteboard, snap a picture on your phone and start implementing it. A couple weeks latter you realize that the design has diverged from the whiteboard so you delete the pictures. The whiteboard was useful for those two weeks to get the discussion started.

The second is maintained, preferably automated. If you use viseo that means an entire team who's only job is to police the code to ensure everybody updates as change happens. Lesson: don't use viseo, use a tool that either generates your code (in C like languages this would be the header files), or a tool that imports the actually code to create diagrams. In either case the reason you do this is because every week you print the diagram out on poster paper and hang it on the wall of your cube/office. (if you are in an open floor plan UML is useless because you don't have a wall to hang it on).


When UML was more popular at the height of the OO(AD) frenzy, there was a tool from Peter Coad's company called TogetherJ. IIRC it could do round-tripping between UML and Java code. I think I tried the tool out but not that feature. TogetherSoft was later acquired by Borland, as I remember.


In IntelliJ you can refactor from UML views.


Interesting, will check that out.


I suppose in an open office you could use your UML diagram printouts to make a cubicle. After a half a year or so, if you keep pasting them up on top of each other, you might start getting some sound-proofing effects.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: