ms-access


Extracting data from 60,000 Facebook ID's in less than 6 hours?


I have downloaded the Faceboojk profile ID's of all of our Facebook fans to an access databse and have written a function to pull the locale data from the Facebook graph api. Here is an example of the graph api:-
http://graph.facebook.com/665117534
My code loops through each record and pulls teh data from the API like this:-
Function fbl(fb_user_id As String) As String
Dim oXMLHTTP As Object, i As Long, vFF As Long, oResp() As Byte
Dim FB_URL As String
Dim fb_user_data As String
Set oXMLHTTP = CreateObject("MSXML2.XMLHTTP")
FB_URL = "http://graph.facebook.com/" & fb_user_id
oXMLHTTP.Open "GET", FB_URL, False
oXMLHTTP.Send
Do While oXMLHTTP.readyState <> 4
DoEvents
Loop
fb_user_data = oXMLHTTP.responsetext
n0 = InStr(1, fb_user_data, "locale") '
If n0 = 0 Then
locale_code = "PAGE"
Else
n00 = InStr(n0, fb_user_data, "}") '
locale_code = Mid(fb_user_data, n0 + 6, n00 - n0)
locale_code = Replace(locale_code, """", "")
locale_code = Replace(locale_code, ",", "")
locale_code = Replace(locale_code, " ", "")
locale_code = Mid(locale_code, 5, Len(locale_code) - 6)
End If
fbl = locale_code
Set oXMLHTTP = Nothing
End Function
This works fine but testing a 100 records took 35 seconds which suggests that the whole table will take 5.6 hours. Is theire a more efficent, speedier way of doing this?
Thanks
Jonathan
My approach has been to use a multi threaded C# application with System.NET.Sockets and turn off the Nagle Algorithm.
I haven't seen many high performance computing applications written in VBA
Edit
Since you're using the XMLHTTP object you should retag this question to reflect that. You may get a better response from people who know that API.

Related Links

Create a Schedule task that run a access file
Does Access 2013 still have an ACE database or equivalent?
Creating 2D (Data Matrix or QR Codes) in MS Access Reports/Forms
Mass Delete Individual Fields
Error on INSERT statement
Microsoft Access 2003 - Expression Builder
Reference existing expression
Automatically updated the textbox
Profiler for MSAccess
Access Switchboard Manager: Invalid Procedure Call or Argument
how should this SQL be written?
Data type for currency values in Access
Update top rows in Access table that match condition
Data type in access 2007
How to specify a custom format for a text pattern in Microsoft Access?
Many to Many in Access

Categories

HOME
winforms
pypi
comparison
json.net
include
relay
sd-card
cplex
paw-app
electronics
v8
acquia
slick-slider
kibana-4
spring-kafka
floating-action-button
carthage
transformation
beyondcompare
mps
csrf-protection
restful-authentication
vlsi
traffic
neo4j-spatial
wtx
librato
android-nestedscrollview
y86
hexo
suricata
serve
jquery-bootgrid
webix-treetable
preconditions
ensembles
janrain
google-closure
keydown
total-commander
sas-jmp
komodoedit
promela
alphabet
mu
aurelia-validation
diagnostics
lift-json
query-performance
fody
skobbler-maps
thrust
gridview-sorting
moveit
whois
bgp
revolution-r
asp.net5
phpcas
iad
jmeter-maven-plugin
android-listview
cakephp-3.1
geonetwork
facebook-graph-api-v2.4
sorl-thumbnail
clicktag
oxwall
c3
jscript.net
winddk
android-imagebutton
asp.net-web-api-odata
id3v2
terminfo
article
navigationservice
industrial
jsctypes
spring-io
web2py-modules
limejs
robotics-studio
delphi-6
javaspaces
twrequest
subgurim-maps
modelstate
simpletest
procedural-music

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App