ms-access


Extracting data from 60,000 Facebook ID's in less than 6 hours?


I have downloaded the Faceboojk profile ID's of all of our Facebook fans to an access databse and have written a function to pull the locale data from the Facebook graph api. Here is an example of the graph api:-
http://graph.facebook.com/665117534
My code loops through each record and pulls teh data from the API like this:-
Function fbl(fb_user_id As String) As String
Dim oXMLHTTP As Object, i As Long, vFF As Long, oResp() As Byte
Dim FB_URL As String
Dim fb_user_data As String
Set oXMLHTTP = CreateObject("MSXML2.XMLHTTP")
FB_URL = "http://graph.facebook.com/" & fb_user_id
oXMLHTTP.Open "GET", FB_URL, False
oXMLHTTP.Send
Do While oXMLHTTP.readyState <> 4
DoEvents
Loop
fb_user_data = oXMLHTTP.responsetext
n0 = InStr(1, fb_user_data, "locale") '
If n0 = 0 Then
locale_code = "PAGE"
Else
n00 = InStr(n0, fb_user_data, "}") '
locale_code = Mid(fb_user_data, n0 + 6, n00 - n0)
locale_code = Replace(locale_code, """", "")
locale_code = Replace(locale_code, ",", "")
locale_code = Replace(locale_code, " ", "")
locale_code = Mid(locale_code, 5, Len(locale_code) - 6)
End If
fbl = locale_code
Set oXMLHTTP = Nothing
End Function
This works fine but testing a 100 records took 35 seconds which suggests that the whole table will take 5.6 hours. Is theire a more efficent, speedier way of doing this?
Thanks
Jonathan
My approach has been to use a multi threaded C# application with System.NET.Sockets and turn off the Nagle Algorithm.
I haven't seen many high performance computing applications written in VBA
Edit
Since you're using the XMLHTTP object you should retag this question to reflect that. You may get a better response from people who know that API.

Related Links

MS Access Front-end: Does each user need their own copy?
trying to filter subform based on contents of field on main form
How to use MS access on a server where MS Office is not installed
How do i import and eliminate first two row of website in msaccess while importing html pages
Multi criteria dlookup issue
Count all checkboxes in ms-access form…what am I doing wrong?
How do I set a default selection to a Listbox in MS Access
Microsoft Access not overwriting when exporting a query to excel
Using ms-access command-line tag /x but database opens read-only
Criteria with TempVars - but prompt user if tempvars is null
Crazy Cursor in TextBox on Table from ODBC database
Count of dates “This Month” to appear in a text box in Access Report
Issue with Removing References in Microsoft Access
Turn Access to Application
Powerpivot + Access + SSAS Cube
How to make the input dates which user type in the prompt show in report ? MS Access 2013

Categories

HOME
ibm-bluemix
yii2
winforms
jdo
reflection
angular-material
getelementsbytagname
rsync
jsrender
angular-ui-bootstrap
directx
webrequest
vifm
vault
imacros
handsontable
modelica
postgres-xl
google-cloud-ml
jplayer
orchardcms
quartz-scheduler
excel-vba-mac
textfield
microsoft-r
hammerspoon
blazemeter
centos6.5
spring-mybatis
elasticsearch-net
procdump
bpel
fabric8
galsim
twilio-api
exuberant-ctags
protovis
accelerate-framework
catalog
host
stacked
git-merge
serve
scaffold
libraries
service-discovery
document.write
trim
ibpy
arena-simulation
.net-4.6.2
osx-mavericks
tizen-native-app
magma
r-forge
ifs
namecoin
knpmenubundle
akka-cluster
time-and-attendance
dstu2-fhir
player
essence
qgraphicsview
suffix-tree
rhino-servicebus
goose
phpcas
hsv
ios8-today-widget
vhd
thredds
purge
coveralls
dereference
inmobi
python-green
client-side-templating
markers
googlemock
rdl
onactivityresult
flask-cors
datagridviewcolumn
flexmojos
uv-mapping
mysqltuner
file-locking
e4x
pvrtc
nsnetservice
armcc
regsvr32
nsmanagedobject
jquery-ui-layout
heartbeat
django-tagging
ecl
radcombobox
w3wp.exe
web-application-design
fixed-width
zend-tool
virtual-functions
geneva-server
wsdl.exe

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App