feat(mm2_persistent_datadir): DB from mm2 is now stored into datafolder #167

Milerius · 2020-05-19T05:55:30Z

eg:

.
├── config
│  ├── default.wallet
│  └── rmn.seed
├── logs
│  ├── 2020-05-18-04-14-59.log
│  ├── 2020-05-18-04-17-22.log
│  ├── 2020-05-18-04-19-12.log
│  ├── 2020-05-18-04-26-50.log
│  ├── 2020-05-18-04-27-54.log
│  ├── 2020-05-18-04-33-40.log
│  ├── 2020-05-18-04-34-53.log
│  ├── 2020-05-18-04-35-19.log
│  └── 2020-05-19-05-32-31.log
└── mm2
   └── DB
      └── cf3d6da1ab1df72e29d94bb531e56d5728f29739
         ├── GTC
         │  ├── checkval
         │  └── orders
         ├── ORDERS
         │  ├── checkval
         │  └── MY
         │     ├── checkval
         │     ├── MAKER
         │     │  └── checkval
         │     └── TAKER
         │        └── checkval
         ├── PRICES
         │  └── checkval
         ├── SWAPS
         │  ├── checkval
         │  ├── MY
         │  │  └── checkval
         │  └── STATS
         │     ├── checkval
         │     ├── MAKER
         │     │  └── checkval
         │     └── TAKER
         │        └── checkval
         ├── TRANSACTIONS
         │  └── checkval
         └── UNSPENTS
            └── checkval

Signed-off-by: romanszterg [email protected]

… folder eg: ``` . ├── config │ ├── default.wallet │ └── rmn.seed ├── logs │ ├── 2020-05-18-04-14-59.log │ ├── 2020-05-18-04-17-22.log │ ├── 2020-05-18-04-19-12.log │ ├── 2020-05-18-04-26-50.log │ ├── 2020-05-18-04-27-54.log │ ├── 2020-05-18-04-33-40.log │ ├── 2020-05-18-04-34-53.log │ ├── 2020-05-18-04-35-19.log │ └── 2020-05-19-05-32-31.log └── mm2 └── DB └── cf3d6da1ab1df72e29d94bb531e56d5728f29739 ├── GTC │ ├── checkval │ └── orders ├── ORDERS │ ├── checkval │ └── MY │ ├── checkval │ ├── MAKER │ │ └── checkval │ └── TAKER │ └── checkval ├── PRICES │ └── checkval ├── SWAPS │ ├── checkval │ ├── MY │ │ └── checkval │ └── STATS │ ├── checkval │ ├── MAKER │ │ └── checkval │ └── TAKER │ └── checkval ├── TRANSACTIONS │ └── checkval └── UNSPENTS └── checkval ``` Signed-off-by: romanszterg <[email protected]>

Signed-off-by: romanszterg <[email protected]>

* CI self-hosted config test #1 * Fix incorrect duplicated job ID * CI test #2 * CI Test #3 Results of test #2: integration tests work when using GitHub-hosted Actions latest ubuntu * CI Test #4 * Test unit/integration tests on hosted runner Test unit/integration tests on the hosted runner to determine if the cause of the failing tests is related to differences between self-hosted and hosted environment. * Update CI conditional statements of self-hosted runners Update CI conditional statements that referenced variables only applicable to self-hosted runners. Change to the equivalent for hosted runners. * Remove very_good_analysis linting dependency Flutter is not fetching dependencies for sub-packages in the `packages` directory, so the very_good_analysis files are missing until `flutter pub get` is ran for each package * Add composite actions for asset generation and build validation * Remove chromedriver from unit tests workflow * Add missing `shell` property to the `generate-assets` action Also remove the default value, and unset the environment variable if it does not exist * Delete the `build/` directory between builds to clear AssetManifest.bin Rebuilds do not appear to consistently update AssetManifest.bin, even if there are new assets generated between builds (icons, coin configs) * Add code coverage report as artefact upload Temporary until link with 3rd-party sources like CodeCov is setup * Only fail the coverage step if the report does not exist The flutter test command failing or passing should not affect the test coverage step success/failure * Fix profit/loss unit tests Binance closing price introduces some variability in the calculated profit/loss that has to be accounted for. The margin of error can be reduced by improved price and timestamp matching, but this should suffice for now * Fix code coverage generation action I forgot the spaces in the bash condition :(. It should be "if [ ... ]; then" * Revert to using `strings` before `grep` to be platform independent macOS handles binary files differently to Linux, meaning that `grep -i ...` works with binary files on Linux systems, but not macOS * Remove trailing spaces in zip generation command Trailing spaces after the backslash in a multi-line command causes it to fail with "command not found" * Prefix artefact with runner name & move coverage step to end of ui tests * Update job names and add descriptions * Switch build_transformer over to the new sdk repo * Remove old build_transformer package * Revert changes to web/src/index.html * Add index.html to .gitignore * Move webpack JS files out of web/src * Revert changes to index.html once more :( * Untrack index.html & update build transformer package * Use default GITHUB_TOKEN to make authenticated requests * Add test case for failing binance requests * demo data generator: check if coin is supported before fetching * Add validation step for build_config.json * Fix silently failing asset manifest validation check * Add json validity checks for coin configs * Update commit sha of build transformer package * Use abstract repository class in generate demo data * Install Chrome alongside chromedriver on linux for UI tests * Skip generate demo test data unit tests * Bump build transformer to dev branch * Switch UI and unit test workflows back to self-hosted runners * Restrict coverage report to linux-based runners * Improve npm build cross-platform compatibility '&&' is invalid in Windows PowerShell. ';' works on Windows, macOS, and Linux * Move Flutter and NodeJS installation to composite action * Add github token to UI and unit test steps Seeing 403 responses on self-hosted runners * Fix UI integration tests on self-hosted macos * Export logs for safaridriver in workflows Use the --diagnose flag when starting safaridriver * Fix failing restore wallet integration test * Add verbose flag to integration test runner * Fix issues with pumpAndSettle timeout Add pumpNFrames and use that instead. This is based on the recommendation in the docs: https://api.flutter.dev/flutter/flutter_test/WidgetTester/pumpAndSettle.html * Fix missing balance overview and back button * Fix wallet & wallet manager integration tests * Fix maker & taker integration tests * Fix misc integration tests * Fix analyse warnings and remove support page test * Pin chromedriver to the self-hosted runner version 116.0.5845.96 with path /opt/google/chrome/chrome * Use mock binance repository for unit testing Using the live Binance endpoints resulted in some variance of the closing price & final calculation that caused the unit tests to fail on occasion. * Add note about the possibility of 403 error --------- Co-authored-by: CharlVS <[email protected]> Co-authored-by: Francois <[email protected]>

…ository first before cex repository (#167) * fix(market-data-manager): default to KomodoPriceRepository Binance CexRepository supports a limited number of symbols and no longer lists KMD price history after the delisting * refactor(market-data-manager): deduplicate and clarify intent * refactor(review): remove zero check and add log statements also simplify the priceIfKnown function

* fix(types): comprehensive bip39 validation * fix(market-data-price): try fetch current price from komodo price repository first before cex repository (#167) * fix(market-data-manager): default to KomodoPriceRepository Binance CexRepository supports a limited number of symbols and no longer lists KMD price history after the delisting * refactor(market-data-manager): deduplicate and clarify intent * refactor(review): remove zero check and add log statements also simplify the priceIfKnown function * chore: switch KDF to `dev` Switch KDF to `dev` to allow usage of unreleased changes (particularly related to fees/priorities) * feat: add Flutter Web WASM support with OPFS interop extensions This commit implements comprehensive Flutter Web WASM support by: - Adding opfs_interop.dart with FileSystemDirectoryHandle extensions for values(), keys(), and entries() methods - Implementing JSAsyncIterator type definitions for proper JavaScript interop - Creating WebLogStorageWasm implementation compatible with both JS and WASM targets - Consolidating platform implementations to use unified WASM-compatible storage - Removing redundant WebLogStorage in favor of cross-compatible implementation - Updating platform configuration files for seamless WASM integration The implementation provides backwards compatibility with JavaScript compilation while enabling full WASM support through browser File System APIs that work consistently across both compilation targets. BREAKING CHANGE: WebLogStorage class has been removed in favor of WebLogStorageWasm * Update packages/dragon_logs/lib/src/storage/opfs_interop.dart Co-authored-by: Copilot <[email protected]> * docs: update repo url * docs: remove repo archive notice * feat(example): integrate dragon_logs (#177) * fix: dart wasm type errors * chore: revert skipped build steps * fix: add GitHub token authentication to prevent API rate limiting Add GitHub authentication token support across all components that make GitHub API requests to resolve rate limiting issues during builds. Changes: - feat(coin-updates): add githubToken parameter to CoinConfigProvider - feat(coin-updates): support GitHub auth in CoinConfigRepository.withDefaults - fix(build-transformer): add debug logging for GitHub API authentication - fix(wallet-cli): auto-use GITHUB_API_PUBLIC_READONLY_TOKEN env variable - style(build-transformer): fix lint issues with cascade operations The CoinConfigProvider was making unauthenticated GitHub API requests, contributing to rate limit errors. All GitHub API clients now properly use the GITHUB_API_PUBLIC_READONLY_TOKEN environment variable when available, increasing rate limits from 60 to 5,000 requests per hour. Fixes: Rate limit exceeded errors during build process * chore(kdf): roll KDF to latest `dev` Roll KDF to the latest `dev` to ensure we are using the latest revision of all unreleased features. * fix: apply cursor fixes --------- Co-authored-by: Francois <[email protected]> Co-authored-by: Copilot <[email protected]>

Milerius marked this pull request as ready for review May 19, 2020 06:14

Milerius changed the title ~~feat(mm2_persistent_datadir): DB from mm2 is now stored into datefolder~~ feat(mm2_persistent_datadir): DB from mm2 is now stored into datafolder May 19, 2020

Milerius requested a review from tonymorony May 19, 2020 06:16

feat(logs): create the log folder if it doesn't exist

ce6e927

Signed-off-by: romanszterg <[email protected]>

ca333 approved these changes May 19, 2020

View reviewed changes

ca333 merged commit c8c0ccc into dev May 19, 2020

Milerius deleted the mm2_persistent_data_dir branch November 8, 2020 05:49

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(mm2_persistent_datadir): DB from mm2 is now stored into datafolder #167

feat(mm2_persistent_datadir): DB from mm2 is now stored into datafolder #167

Uh oh!

Milerius commented May 19, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

feat(mm2_persistent_datadir): DB from mm2 is now stored into datafolder #167

feat(mm2_persistent_datadir): DB from mm2 is now stored into datafolder #167

Uh oh!

Conversation

Milerius commented May 19, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants