Tuesday, November 6, 2018

Spending some hours with web scraper

Working on higher speed buffer management, bog buffers work best, it does all the skip ahead arithmetic and handles offsets to src pointers.  And is accurate to the character about extracting plain text. A key technology is the must have, killer application , the auto-reader, something that summarizes the days reading before you  do. Like a Watson, every executive will want one tuned to theory environment and trade press. Industry will sprout, this really is a time saver.

Below the break is the text from the economic rtable site, a complex listing of other bloggers.  You can see an occasional miss, likely I need to identify a special singleton tag, or some other html corner condition.  But otherwise, working fine, I call that one annoying bug and I can move on to more complete integration. Use my macro shell to set up a list of html files, pre collected, stuff them into a join slot for searching.

Scraper can be modified, to collect links; or to collect links in an intermixed structure with Dom structured plain text. Add the http Get adn Put device to join, then is it interactive, taking reading tasks from the human operator as he orders ot for further research or drill down. A tool like this can integrate well with Wiki, a structured html format,  as the plain text closely follows the html Dom structure.   general title really do mean general titles, and this will fall out of the plaintext linkage.




ejoice. The New Apple Emojis Are Here at Last
y Raisa Bruner of TIME: The Curious Capitalist
ctober 30, 2018, 12:42 pm, 1913478



he US Ten-Year Shows The Extent Of The Bond Bubble
udwig von Mises Institute Articles
ctober 30, 2018, 12:39 pm, 1913461
Ç£Only when the tide goes out do you discover whoΓÇÖs been swimming naked.ΓÇ¥ ΓÇô Warren Buffett
arlier this month, the US 10-year bond reached a yield of 3.2%, the highest since 2011. As inflation in the United States picks up, the economy grows
nt falls to ...


ises Institute at LibertyCon
udwig von Mises Institute Articles
ctober 30, 2018, 12:39 pm, 1913460



ealizing the Potential of the G20 Compact with Africa
y IMFBlog of iMFdirect
ctober 30, 2018, 12:38 pm, 1913459
y Christine Lagarde
ctober 30, 2018

ower Plant, Abidjan, Cote dΓÇÖIvoire. Development finance institutions can contribute expertise in the design and financing of large investment projec
rry Gouegnon/Reuters/Newsom)

he Compact with Africa ...


pdate: A few comments on the Seasonal Pattern for House Prices
alculated Risk
ctober 30, 2018, 12:35 pm, 1913458
R Note: This is a repeat of earlier posts with updated graphs.A few key points:1) There is a clear seasonal pattern for house prices.2) The surge in d
rted the seasonal pattern.3) Even though distressed sales are down significantly, the ...


he Italian economy is on a short fuse - AEI - American Enterprise Institute: Freedom, Opportunity, Enterprise
y Matt Winesett of AEI ┬╗ Latest Content
ctober 30, 2018, 12:04 pm, 1913447
his morningΓÇÖs dismal Italian GDP numbers are bound to complicate efforts to strike a compromise between Italy and the European Commission on that co
ot bode well for either the Italian or the global economies in the months immediately ahead.
ccording to data released for the ...


uesday assorted links
y Tyler Cowen of Marginal Revolution
ctober 30, 2018, 11:48 am, 1913435
. David Perell on marketing.
. David Gelernter on stuff I don’t want you to discuss in the comments section.
. Bytedance (the world’s most valuable start-up?, NYT).
. More on Bolsonaro.  Delusional in some ways, most of all in ...


ew MacBook Air, iPad Pro and More: Everything Apple Just Announced
y Alex Fitzpatrick of TIME: The Curious Capitalist
ctober 30, 2018, 11:31 am, 1913434



ew MacBook Air, iPad Pro and More: Everything Apple Just Announced
y Alex Fitzpatrick of TIME: The Curious Capitalist
ctober 30, 2018, 11:31 am, 1913433



he Right to Vote IsnΓÇÖt Remotely Sufficient to Guarantee Freedom or Even ΓÇÿVoiceΓÇÖ
y Don Boudreaux of Cafe Hayek
ctober 30, 2018, 11:04 am, 1913399
Don Boudreaux)



weetIn my latest column for ...


 Libertarian Critique of Birthright Citizenship
udwig von Mises Institute Articles
ctober 30, 2018, 10:39 am, 1913385
ne vexing current problem centers on who becomes the citizen of a given country, since citizenship confers voting rights.
he Anglo-American model, in which every baby born in the country's land area automatically becomes a citizen, clearly invites welfare immigration by e
 current problem ...


VS: Q3 2018 Homeownership and Vacancy Rates
alculated Risk
ctober 30, 2018, 10:35 am, 1913384
he Census Bureau released the Residential Vacancies and Homeownership report for Q3 2018. This report is frequently mentioned by analysts and the medi
ship rate, and the homeowner and rental vacancy rates.á However, there are serious questions about the accuracy of this ...


oliticized law enforcement and the ExxonMobil white whale - AEI - American Enterprise Institute: Freedom, Opportunity, Enterprise
y Yisehak Abraham of AEI ┬╗ Latest Content
ctober 30, 2018, 10:34 am, 1913383
he latest lawsuit against ExxonMobil (EM), filed by Acting New York State Attorney General Barbara Underwood, is straightforward:

M uses one general ΓÇ£proxy costΓÇ¥ for the costs of prospective greenhouse gas (GHG) policies averaged over the entire firmΓÇÖs worldwide operations.

No comments: