Hey folks.
I am looking at implementing a project and I'd like some guidance on how best and efficient to process it.
I have a large number of remote computers that will be gathering information (strings). They will gather approximately 100 per hour. In theory, if I have 1000 remote computers doing this, that is a total of 100,000 values per hour. Now what I want to do is compare these to a precompiled list of values. Now should a new value appear in the remote computer's list that matches a value in the precompiled list, I'd like information associated with this value to be transferred to a central database. Now unfortunately, the remote computers don't have the best internet connections and sometimes they drop out hence why I need to store the info at a local level initially as opposed to carrying out instant comparisons over the internet.
Now here's my questions:-
1.) The central database will be populated with new values each day and the remote computers need to be made aware of these new values. Ideally I don't want to have to transmit a full table each day and therefore, is there a way of just transferring new values to a replica table on several remote computers? If so, how?
2.) What are the best methods of securing communication over the internet between a locally-held DB and a central DB?
Many thanks all
I am looking at implementing a project and I'd like some guidance on how best and efficient to process it.
I have a large number of remote computers that will be gathering information (strings). They will gather approximately 100 per hour. In theory, if I have 1000 remote computers doing this, that is a total of 100,000 values per hour. Now what I want to do is compare these to a precompiled list of values. Now should a new value appear in the remote computer's list that matches a value in the precompiled list, I'd like information associated with this value to be transferred to a central database. Now unfortunately, the remote computers don't have the best internet connections and sometimes they drop out hence why I need to store the info at a local level initially as opposed to carrying out instant comparisons over the internet.
Now here's my questions:-
1.) The central database will be populated with new values each day and the remote computers need to be made aware of these new values. Ideally I don't want to have to transmit a full table each day and therefore, is there a way of just transferring new values to a replica table on several remote computers? If so, how?
2.) What are the best methods of securing communication over the internet between a locally-held DB and a central DB?
Many thanks all