Page 1 of 2 12 LastLast
Results 1 to 25 of 46
  1. #1
    dangerous floater Winehole23's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2008
    Post Count
    90,254
    Market Data Firm Spots the Tracks of Bizarre Robot Traders

    Aug 4 2010, 8:01 AM ET | Comment


    Mysterious and possibly nefarious trading algorithms are operating every minute of every day in the nation's stock exchanges.

    What they do doesn't show up in Google Finance, let alone in the pages of the Wall Street Journal. No one really knows how they operate or why. But over the past few weeks, Nanex, a data services firm has dragged some of the odder algorithm specimens into the light.

    The trading bots visualized in the stock charts in this story aren't doing anything that could be construed to help the market. Unknown en ies for unknown reasons are sending thousands of orders a second through the electronic stock exchanges with no intent to actually trade. Often, the buy or sell prices that they are offering are so far from the market price that there's no way they'd ever be part of a trade. The bots sketch out odd patterns with their orders, leaving patterns in the data that are largely invisible to market participants.

    In fact, it's hard to figure out exactly what they're up to or gauge their impact. Are they doing something illicit? If so, what? Or do the patterns emerge spontaneously, a kind of mechanical accident? If so, why? No matter what the answers to these questions turn out to be, we're witnessing a market phenomenon that is not easily explained. And it's really bizarre.

    It's thanks to Nanex, the data services firm, that we know what their handiwork looks like at all. In the aftermath of the May 6 "flash crash," which saw the Dow plunge nearly 1,000 points in just a few minutes, the company spent weeks digging into their market recordings, replaying the day's trades and trying to understand what happened. Most stock charts show, at best, detail down to the one-minute scale, but Nanex's data shows much finer slices of time. The company's software engineer Jeffrey Donovan stared and stared at the data. He began to think that he could see odd patterns emerge from the numbers. He had a hunch that if he plotted the action around a stock sequentially at the millisecond range, he'd find something. When he tried it, he was blown away by the pattern. He called it "The Knife." This is what he saw:



    "When I pulled up that first chart, we saw 'the knife,' we said, that's certainly algorithmic and that is weird. We continued to refine our software, honing the algorithms we use to find this stuff," Donovan told me. Now that he knows where and how to look, he could spend all day for weeks just picking out these patterns in the market data. The examples that he posts online are just the ones that look the most interesting, but at any given moment, some kind of bot is making moves like this in the stock exchange.



    "We probably get 10 stocks in any 10 minutes where we see something like this," Donovan said. "It's happening all the time."



    These odd bots don't really make sense within the normal parameters of the high-frequency trading business. High-frequency traders do employ algorithms to look for patterns in the market and exploit them, but their goal is making winning trades, not simply sending quotes into the financial ether.


    Here's the way a stock trade is supposed to work: a buyer says they'll pay some amount for 100 shares of a company, a seller makes an ask for slightly more money, and the two of them usually meet in the middle. Perhaps a middle man (no joke intended) helps match buyer and seller and takes a cut. That's the role that a lot of high-frequency traders play: they help make markets work. Regulatory changes over the past several years have extended their usefulness and provided a nice business model for those that can move quickly to provide options for buyers and sellers.


    "Under the maker-taker model, market participants that offer to provide, or make, liquidity by posting an order to buy or sell a certain number of shares at a particular price receive a rebate," explained Michael Peltz in a June feature for Ins utional Investor. "Those that execute against that order -- that is, take the liquidity -- have to pay a fee. Exchanges earn the difference between the rebate they pay and the fee they charge. The SEC limits taker fees to 0.30 cents a share; rebates tend to be lower for economic reasons, but for high frequency firms trading millions of shares a day, they can make for a pretty good living."



    In a sense, they take nickel-and-diming down an order of magnitude or two. The advantage is that their trades are low-risk: they rarely hold positions for very long and any individual stock, future, or currency can't really sink the boat. High-frequency traders have become a target for all kinds of people, but most of them appear to make their money being a little faster and little smarter than their compe ors. And if they are playing by the rules, they improve the quality of markets by minuscule amounts trade after trade after trade.


    But the algorithms we see at work here are different. They don't serve any function in the market. University of Pennsylvania finance professor, Michael Kearns, a specialist in algorithmic trading, called the patterns "curious," and noted that it wasn't immediately apparent what such order placement strategies might do.


    Donovan thinks that the odd algorithms are just a way of introducing noise into the works. Other firms have to deal with that noise, but the originating en y can easily filter it out because they know what they did. Perhaps that gives them an advantage of some milliseconds. In the highly compe ive and fast HFT world, where even one's physical proximity to a stock exchange matters, market players could be looking for any advantage.



    "They are moving the high-frequency services as close to the exchanges as possible because even the speed of light matters," in such a compe ive market, said Stanford finance professor Peter Hansen.


    Given Nanex's data, let's say that these algorithms are being run each and every day, just about every minute. Are they really a big deal? Donovan said that quote stuffing or market spoofing played a role in the Flash Crash, but that event appears to have had so many causes and failures that it's nearly impossible to apportion blame. (It is worth noting that European markets are largely protected from a similar event by volatility interruption auctions.)

    But already since the May event, Nanex's monitoring turned up another potentially disastrous situation. On July 16 in a quiet hour before the market opened, suddenly they saw a huge e in bandwidth. When they looked at the data, they found that 84,000 quotes for each of 300 stocks had been made in under 20 seconds.

    "This all happened pre-market when volume is low, but if this kind of burst had come in at a time when we were getting hit hardest, I guarantee it would have caused delays in the [central quotation system]," Donovan said. That, in turn, could have become one of those dominoes that always seem to present themselves whenever there is a catastrophic failure of a complex system.


    There are ways to prevent quote stuffing, of course, and at least one of the members of the Commodity Futures Trading Commission's Technology Advisory Committee thinks it should be outlawed.



    "Algorithms that might be spoofing the market are something that should be made illegal," said John Bates, a former Cambridge professor and the CTO of Progress Software. But he didn't want this presumably negative practice to color the more mundane compe ive practices of high-frequency traders.



    "There is algorithmic terrorism and then there is reverse engineering, which is probably just part of good business practice," Bates said.



    For now, Donovan plans to keep putting out the charts, which he calls "crop circles," of the odd trading algorithms at work. That's an apt name for the visualizations we see of this alien world of bot trading. And it certainly gets at a central mystery surrounding them: if trading firms aren't sending out these orders, how are they getting into the market?


    On the quan ative trading forum, Nuclear Phynance, the consensus on the patterns seemed to be that they simply just emerged. They were the result of "a dynamical system that can enter oscillatory/unstable modes of behaviour," as one member put it. If so, what you see here really is just the afterscent of robot traders gliding through the green-on-black darkness of the financial system on their way from one real trade to another.


    No matter why the bots end up executing these behaviors, the Nanex charts offer a window onto a kind of market behavior that's fascinating and oddly beautiful. And we may never have seen them, if not for the mildly obsessive behavior of one dedicated nerd.


    "Who looks at millisecond charts?" Donovan said. "You'd never see those patterns in any other fashion. The SEC and CFTC certainly weren't."



    Here are a few more bots at work with explanations of what's going on.




    Here we see a "flag repeater" being executed on the BATS Exchange, the third-largest equity market after the NYSE and NASDAQ. 15,000 quote requests were made in 11 seconds in a repeating pattern. Each iteration upped the quote a penny until $9.36, and then the algorithm went down the same way, a penny at a time.





    This is an extreme closeup of just one second of trading of the stock SHG, the Shinhan Financial Group. This is 760 quotes from a total of 10,000 made in 12 seconds.





    This chart shows a different kind of strategy. It represents 56,000 quotes in one second all at the same price (the top chart) but with the size of the order increasing by one (i.e. 100 shares) all the way up to 40,000.




    Finally, we see what Donovan calls the "stubby triangles" chart. It shows high quotes being made and then immediately followed by a stub order of $0.01 (basically canceled in most contexts). The quote is then remade at a lower price and followed with another stub quote. This cycle happened at the rate of 380 quotes a second. [This last description was clarified thanks to the kindness of author Joe Flood.]

  2. #2
    Veteran
    My Team
    San Antonio Spurs
    Join Date
    Mar 2009
    Post Count
    97,522
    Lloyd Blankfein, whose Goldman Sacks dominates high-speed trading, says he's doing God's work and providing liquidity.

    High-speed trading is nothing but a pump-and-dump fraud.

  3. #3
    I play pretty, no? TeyshaBlue's Avatar
    My Team
    Dallas Mavericks
    Join Date
    Jun 2006
    Post Count
    13,319
    My head asplode.

  4. #4
    dangerous floater Winehole23's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2008
    Post Count
    90,254
    High-speed trading is nothing but a pump-and-dump fraud.
    The author of the OP reaches no such conclusion. How did you?

    Care to show us your math?

  5. #5
    Veteran
    My Team
    San Antonio Spurs
    Join Date
    Mar 2009
    Post Count
    97,522
    the computer sees a price bid, the computer bids a "bit" higher, other computers see the same action, make their itsy bitty teeny weeny bids, price pumps up,

    Whoever Dumps First, Wins.

  6. #6
    dangerous floater Winehole23's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2008
    Post Count
    90,254
    Explain the stubby triangles then. That's a repe ive descending pattern.

  7. #7
    Cogito Ergo Sum LnGrrrR's Avatar
    My Team
    Boston Celtics
    Join Date
    Oct 2008
    Post Count
    22,399
    Did anyone else see the move Pi? Has the author started looking for the Golden Spiral?

    Or maybe it's just that these machines have developed consciousness and are trying to destroy us monetarily in order to assist the takeover...

  8. #8
    The D.R.A. Drachen's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2004
    Post Count
    11,214
    Explain the stubby triangles then. That's a repe ive descending pattern.
    I don't agree with B_D's explanation, however if you have a repe ive downward pattern, then shorting can explain that.

  9. #9
    Veteran
    My Team
    Utah Jazz
    Join Date
    Dec 2007
    Post Count
    7,778
    Did anyone else see the move Pi? Has the author started looking for the Golden Spiral?

    Or maybe it's just that these machines have developed consciousness and are trying to destroy us monetarily in order to assist the takeover...
    I'm not smart enough to know anything about finance markets, but I'm really into self organizational patterns/coherency. I don't know what all this means, but I do find it fascinating.

  10. #10
    Cogito Ergo Sum LnGrrrR's Avatar
    My Team
    Boston Celtics
    Join Date
    Oct 2008
    Post Count
    22,399
    I'm not smart enough to know anything about finance markets, but I'm really into self organizational patterns/coherency. I don't know what all this means, but I do find it fascinating.
    You should check out Pi then. It's pretty much all about finding patterns.

  11. #11
    dangerous floater Winehole23's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2008
    Post Count
    90,254
    I don't agree with B_D's explanation, however if you have a repe ive downward pattern, then shorting can explain that.
    Maybe so.

  12. #12
    dangerous floater Winehole23's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2008
    Post Count
    90,254
    Creating confusing noise for the compe ion makes more sense to me, but who knows.

  13. #13
    Mr. John Wayne CosmicCowboy's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Mar 2003
    Post Count
    43,869
    It's an interesting phenomenon

    Maybe trolling and hoping someone else's automated system goofs? Bidding much lower than going price and with a goof a trade gets made which then moves the market as the automated systems follow and bid/ask with each other?

  14. #14
    The D.R.A. Drachen's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2004
    Post Count
    11,214
    Creating confusing noise for the compe ion makes more sense to me, but who knows.
    I also agree, when the speed of light actually matters, this could have big implications for the compe ion.

  15. #15
    Veteran
    My Team
    San Antonio Spurs
    Join Date
    Mar 2009
    Post Count
    97,522
    I know a guy who writes algorithms for D.E.Shaw, a "quant". He's not a trader, has a master's in math. He's worth many, many $Ms by age 40.

  16. #16
    The D.R.A. Drachen's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2004
    Post Count
    11,214
    I know a guy who writes algorithms for D.E.Shaw, a "quant". He's not a trader, has a master's in math. He's worth many, many $Ms by age 40.
    Yep, these quants are secretive and rich from everything I have read about them.

  17. #17
    Veteran Wild Cobra's Avatar
    My Team
    Portland Trailblazers
    Join Date
    May 2007
    Post Count
    43,117
    maybe someone found out how to take advantage of rounding errors, to make money.

    Remember Gus Gorman getting rich when he had all the companies 1/2 cents moved to his paycheck?

  18. #18
    W4A1 143 43CK? Nbadan's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2001
    Post Count
    32,408
    This is very interesting...it must have been purposely written into the trading algorithm of a major trading firm because of the number of shares that are being moved around...why? hard to tell...sinister? Will it give someone a unfair advantage? whom?

  19. #19
    🏆🏆🏆🏆🏆 ElNono's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Apr 2007
    Post Count
    152,695
    Inserting short bursts of predictability into what's supposed to be a fairly unpredictable medium. Think about that for a second, and the implications.

  20. #20
    W4A1 143 43CK? Nbadan's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Nov 2001
    Post Count
    32,408
    inserting short bursts of predictability into what's supposed to be a fairly unpredictable medium. Think about that for a second, and the implications.
    I guess you could look at it that way, or you could look at it as inserting instability into the market..perhaps I just don't see how going up and coming down in short ripples versus a smooth natural bell curve gives anyone an advantage...

  21. #21
    🏆🏆🏆🏆🏆 ElNono's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Apr 2007
    Post Count
    152,695
    I guess you could look at it that way, or you could look at it as inserting instability into the market..perhaps I just don't see how going up and coming down in short ripples versus a smooth natural bell curve gives anyone an advantage...
    Creating non-predictable noise is actually pretty simple these days. Plenty of entropy sources. I've uses DOD level RNGs in the past. To insert instability you would insert random noise. When you're inserting clearly defined patterns you're inserting predictability.

  22. #22
    🏆🏆🏆🏆🏆 ElNono's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Apr 2007
    Post Count
    152,695
    Which also ties in with why would you need faster-than-light connections to the exchanges. The only reason I can think of where you need such speed is because you need major precision. If you're doing trades down to the millisecond, then you need all the speed you can get.

  23. #23
    Take the fcking keys away baseline bum's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Mar 2003
    Post Count
    94,008
    You should check out Pi then. It's pretty much all about finding patterns.
    I thought it was more about the perversion of science by magical thinking and the tragic story of a completely wasted career.

  24. #24
    Take the fcking keys away baseline bum's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Mar 2003
    Post Count
    94,008


    My best guess would be trying to raise concurrency bugs in other systems and fishing for arbitrage opportunities from them. You'd have to be pretty damn confident in your own code though.

  25. #25
    Take the fcking keys away baseline bum's Avatar
    My Team
    San Antonio Spurs
    Join Date
    Mar 2003
    Post Count
    94,008
    maybe someone found out how to take advantage of rounding errors, to make money.
    I believe financial math involving actual trades is always done with rational arithmetic, as round-off would be completely unacceptable in this case.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •