Wednesday, October 21, 2009

Large Search-Querry datasets

On a blog I recently visited, it was pointed out in context of a web search analysis study that: "This study also highlights the current situation in web-scale research: that only companies like Microsoft, Google or Yahoo! have access to the sheer volume of data needed to do such an analaysis." (sorry I do not remember the source of this, if it is ur blog please let me know, so I can reference you) This has been brought up numerous times in the past and I couldnt agree more. What is really very important is for society (/ internet users) to realise that they are the creators of the content and they should demand access to the agregatted datasets [Tapscott&Williams in Wikinomics - How Mass Collaboration Changes Everything]. Or in other words (since most people wouldnt know what to do with the datasets) some kind of compensation. This applies less to search engines, since they provide a free service, and applies more to other collaborative web 2.0 apps. However, search engines make money on advertising, so thats the reason why they are free to use, not because users are being compensated for the datasets that these search companies decide to store and aggregate.

My criticism is that search engines shouldn't keep the raw data hidden behind proprietary domains but open up to the world research community.

1 comment:

  1. PM & ANALYST ROLES - EMAIL JONATHAN@10XCAP.COM

    We are currently searching for the following: Please email if you have any questions.

    ALL APPLICANTS MUST HAVE CURRENT BUY SIDE EXPERIENCE. PREFERABLY MAKING THE MOVE FROM A HEDGE FUND.

    IF YOU ARE CURRENTLY AT A HF AND WOULD LIKE MORE INFO CALL/EMAIL JONATHAN - JONATHAN@10XCAP.COM | 212.929.4245


    TMT PM- TOP 5 HF- NYC/CT
    REITS PM – TOP 20 HF - NYC
    FINANCIALS PM – TOP 10 HF – NYC/CT
    MEDIA PM – TOP 20 HF - NYC
    TECH PM – TOP 20 HF NYC
    INDUSTRIALS PM – TOP 10 HF - CT
    BASIC MATERIALS PM – TOP 20 HF – NYC
    ALL SECTOR PM’S - CHICAGO

    TMT - ANALYST - 10BN+ HF East coast
    ENERGY ANALYST – 2 BN HF - NYC
    EQUITY DERIVATIVES ANALYST – 9 BN HF – MIDWEST
    MED TECH ANALYST – NYC
    INDUSTRIALS ANALYST – NYC
    CONSUMER STAPLES ANALYST (GLOBAL FOCUS) – CT
    GENERALIST ANALYST (SENIOR) – CT
    OLD ECONOMY GENERALIST WITH VALUE BEND – CT
    JUNIOR ANALYST WITH GOOD TECHNICAL SKILLS AND CAN GENERATE INDEAS - CT

    JUNIOR analyst must have minimal 1-2 yrs currently at a hedge fund and TOP schools - for 10bn+ HF NY/CT/MA

    Big Book Managers FOR THE PM SPOTS - only, Must have strong track record, (down08-ok) currently/very recently running book at 1bn+ hedge fund.


    www.10xcap.com
    jonathan@10xcap.com
    Jonathan -212.929.4245

    ReplyDelete