{"id":44,"date":"2002-08-14T17:48:07","date_gmt":"2002-08-14T21:48:07","guid":{"rendered":"http:\/\/wordpress.cephas.net\/?p=44"},"modified":"2002-08-14T17:48:07","modified_gmt":"2002-08-14T21:48:07","slug":"importing-large45mb-xml-files","status":"publish","type":"post","link":"https:\/\/cephas.net\/blog\/2002\/08\/14\/importing-large45mb-xml-files\/","title":{"rendered":"importing large(45mb) xml files"},"content":{"rendered":"<p>I <a href=\"http:\/\/cephas.net\/blog\/archives\/000027.html#000027\">mentioned<\/a> that I had to import a large weather file as part of the FJ project&#8230; it *works* using simple VBScript and MSXML but it turns out that it kills the server.  Couple other options I found:<\/p>\n<p>a) probably the best way to do it was would be to use SAX instead of DOM, unfortunately <a href=\"http:\/\/msdn.microsoft.com\/library\/default.asp?url=\/library\/en-us\/xmlsdk\/htm\/sdk_intro_6g53.asp?frame=true\">MSXML<\/a> doesn&#8217;t support SAX via VBScript, only C++ and Visual Basic.  Applicable article <a href=\"http:\/\/msdn.microsoft.com\/library\/default.asp?url=\/library\/en-us\/xmlsdk\/htm\/sax_devgd_hdi_extractdata_7wtr.asp?frame=true\">here<\/a> on MSDN re: extracting data from a large document.<\/p>\n<p>b) import the data directly into SQL Server using SQL Server Bulk Load functionality, which is the way I&#8217;m heading right now&#8230;  How to? <a href=\"http:\/\/www.perfectxml.com\/Articles\/xml\/importxmlsql.asp\">Here<\/a>. <\/p>\n<p>Great article <a href=\"http:\/\/xml.oreilly.com\/news\/xmlnut4_0501.html\">here<\/a> on using SAX 2.0 and Java to process large XML documents.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I mentioned that I had to import a large weather file as part of the FJ project&#8230; it *works* using simple VBScript and MSXML but it turns out that it kills the server. Couple other options I found: a) probably the best way to do it was would be to use SAX instead of DOM, &hellip; <a href=\"https:\/\/cephas.net\/blog\/2002\/08\/14\/importing-large45mb-xml-files\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">importing large(45mb) xml files<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[10],"tags":[],"_links":{"self":[{"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/posts\/44"}],"collection":[{"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/comments?post=44"}],"version-history":[{"count":0,"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/posts\/44\/revisions"}],"wp:attachment":[{"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/media?parent=44"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/categories?post=44"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cephas.net\/blog\/wp-json\/wp\/v2\/tags?post=44"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}