Use surfpool fork of mainnet to simulateTransaction

[zenon8adams]

I have a use case where instead of running full nodes, I want to spin off tiny instance of LiteSVM backed surfpool to load mainnet programs and continuously simulate mainnet transactions with them. I've seen it done with LiteSVM by Titan. I'd love for you to provide examples of how this can be done.

[daog1]

Run the surfpool without needing to do anything else. Write a transaction to call a contract using TypeScript (or any other language), as you would on the mainnet, but replace the RPC with surfpool's local connection. Surfpool will automatically download the data for addresses included in the transaction from the mainnet. Just run it.

[zenon8adams]

Yeah. I did, sometimes I get an AddressLookupTableNotFound error. I thought AddressLookupTable program ought to be loaded by default? Also, does it automatically track updates to accounts?

[adpthegreat]

Hey @zenon8adams can you please share the error you have with the lookup tables thanks.
Also to track updates to account is currently a WIP, a geyser plugin has to be implemented to stream changes , the issue is currently being discussed here #100

[adpthegreat]

The accounts in the instruction, the address lookup tables, and the accounts that the ix accesses from the indexes in the lookup table are all fetched during processing so i find that you have the error strange, also please check if you are using the latest version of surfpool if not update it, thanks

[zenon8adams]

This is my request:

curl 'http://127.0.0.1:8899' -s -X POST -H "Content-Type: application/json" -d '
                                    {
                                      "jsonrpc": "2.0",
                                      "id": 1,
                                      "method": "simulateTransaction",
                                      "params": [
                                        "AQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAQAFED3jjZajArbqyP41oIRcdLFsRU/6P2dDm4uiiwqSMkEnKoyR9nNz1m2D+GREcu09/XtGOYTw9f254yvrl3ekthw4AciRc/6MiXjQIWCX5+3q02bOsSR457gFdL/3Lh+okEyhZMNJOn9Wvl2HlsiapPXKpp84yNYbq18gIChgAXi7ZzIkZ5+DiTLCBo46tjwLy9Yw536uHHUrJZRfv2ePvAJpwjHQr5OLsd9of6ZExFGlbNCjNgXkoC3ejO7/7zVqTYe1I/p3Gy551653GdDPX3KX0D4dWPXyZvsBemb3XlwHjsrk+SvwLu0mnSegYpq0vP+S1iRumWaXUyupxafRn1yaBVqK5mpQFQzrOswBj/UrRVMEXxD0MeNXVb92snCm1tSYQkW6R1/0j91vYEGjE9BHdEvunNLz/Y8xitVOL11K9JXopPY5L9d+tnaIZjNyCJX8sUL3snd3L4/2yF45wKuCl+VE/0RAahO3+mTCz/o+xuFd+JNeAMdBcN6u8BPzfawfg/25zlUN6V1VjNx5VGHM9DdKxojsE6mEACIKeNoGAwZGb+UhFzL/7K26csOb57yM5bvF9xJrLEObOkAAAAC0P/on9df2SnTAmx8pWHneSwmrNt/J3VFLMhqns4zl6AR51VvyMcBu7nTFbs5oFQf9sbLeo/SOUQKxzaJWvBOPyMDybzIpMjByqbpo3RUARP8lrpwL2ADuJ1W1LVY70ewDDQAFAsBcFQANAAkDa2IBAAAAAAAPKR8LAAcDCggcHQIPDg8gHwsZBhYDFxUYBB4bCxoSBgoTEBQfAREFCQ8MKcEgmzNB1pyBBgIAAAARAGQAARpkAQKd0t3vAAAAAEU3BAAAAAAAMgAFAj3CFqkkzGJiDVj9L1tE5auNd+V1kIVzIwT+ydt4WSSEBSspFxYYAiUqu2VXViWSaCZ7wb+bi5wIqfldrYubCeLp8VowLvqijGsFkZOSiMkFi4WOCAY=",
                                        {
                                          "encoding":"base64",
                                          "replaceRecentBlockhash":true
                                        }
                                      ]
                                    }'

This is surfpool's response after I pull the latest changes:

{
  "jsonrpc": "2.0",
  "result": {
    "context": {
      "slot": 341459305,
      "apiVersion": "2.2.2"
    },
    "value": {
      "err": "AddressLookupTableNotFound",
      "logs": [],
      "accounts": null,
      "unitsConsumed": 0,
      "returnData": {
        "programId": "11111111111111111111111111111111",
        "data": [
          "",
          "base64"
        ]
      },
      "innerInstructions": null,
      "replacementBlockhash": {
        "blockhash": "6kLUCVT6kgJY5v73XCNhaD6jkMgEMWnWtt7NdGutKYdg",
        "lastValidBlockHeight": 52
      }
    }
  },
  "id": 1
}`

[adpthegreat]

Okay i think i've seen whats causing the error, the simulateTransaction, method does not actually simulate the txn with the needed lookup table accounts it calls the method on litesvm directly, and it does not have that lookup table accounts internally https://github.com/txtx/surfpool/blob/8578549491e6f56ddc1bbe2a7117d26ac5c0a2ef/crates/core/src/surfnet/mod.rs#L856 , it was only implemented for the process_transaction as you can see here https://github.com/txtx/surfpool/blob/8578549491e6f56ddc1bbe2a7117d26ac5c0a2ef/crates/core/src/surfnet/mod.rs#L913 i'll push a fix and test it, so the problem is from our end, apologies

[zenon8adams]

Beautiful! Thanks. I really appreciate your work. Also, on the question of can it track accounts for updates to their states?

[adpthegreat]

Hey @zenon8adams can you please share the error you have with the lookup tables thanks. Also to track updates to account is currently a WIP, a geyser plugin has to be implemented to stream changes , the issue is currently being discussed here #100

I answered it here

[zenon8adams]

I've read #100. It's an interesting issue you outlined. For someone like me that doesn't plan to update surfpool states locally, can I do without geyser? It seems like there's a sweet spot between requirements of those that see use surfpool to mutate their local states and mine that sees it as a local mainnet rpc fork.

[adpthegreat]

I see, alright that will be discussed

[lgalabru]

hey @zenon8adams thanks for the feedback!

just to be sure I understand your usage of Surfpool, are you building your program using the SurfnetSvm? or launching surfpool start?

[zenon8adams]

I thought I could only do surfpool start? Nice, just checked the article. I was looking for something like that. I even had to edit the code to set my rpc node. But can I use surfpool start to still test?

[adpthegreat]

i think this has been closed by #138 ? @lgalabru

[zenon8adams]

@adpthegreat Oh my God! This works! 🎉