- How to find out which leads are converted from a specific landing page
- ReadSitecoreItemsStepProcessor and Buckets
- Error building monero-stratum on macOS
- Resetting address variables
- DAPP - Data Storage for Complex application
- light-locker: strange beheavior when trying to unlock the screen/open the lid
- AppCenter, more Apps needed:
- Can I waive off my constitutional rights?
- Can you “make” an insurer fix a total loss vehicle?
- Legalities of using Trademarked Fictional Names for products
- Could a nerve agent be used recreationally?
- Why does the music video of “Living Next Door to Alice” by Smokie seem happy?
- Number of columns highlighted
- How do those pens work?
- Did Richard Feynman ever meet Stephen Hawking or comment on Hawking radiation?
- What is the history and motivation for the (d-1,1) notation used to describe a field theory?
- Create a new file in a new fold
- Tiling rectangles with Heptomino plus rectangle #6
- Why the performance of VGG-16 is better than Inception V3?
- What is the difference of the implementation between synced many-to-many and unsynced many-to-many in Keras?
Fetch Only new data from auto-updating online sql database
I have an online MySQL (presto) database which keeps on auto-updating (i.e., new rows keep getting added to the tables(views, to be exact) every day). I want to fetch the data from it every day but don't want to refetch the data that I have already fetched before.
I am using python3 for extracting the data from the online host database as:
from pyhive import presto
import numpy as np
sql = 'select * from schema.table'
rows = np.array(cursor.fetchall())
Doing this takes time and fetches all the data (new data as well as already fetched data). I am storing the data in rows variable in a csv file afterward.
Is there any way to get only the new data (id is the primary key in the table)?
Thanks in advance.