[Official] Findora Announcement Channel – Telegram
[Official] Findora Announcement Channel
416 subscribers
13 photos
1 video
1 file
124 links
Findora Official group: https://news.1rj.ru/str/findoraen
Download Telegram
🎙️ Join us for a Twitter Space with Enders Gate as a guest speaker. We're discussing the launch of GSCs on Findora and the launch partnership with Enders Gate.

We hope to see you there! ⤵️
https://twitter.com/i/spaces/1RDGlaywdbOJL
🎉 The Game Chain Challenges Are Live!

Celebrate the launch of Enders Gate on the first Findora GSC in a series of fun Galxe challenges!

Highlights:
$850 in prizes
Three Galxe OATs up for grabs
Have fun playing and winning at Enders Gate!

There are bonus rewards for those who refer friends OR who win a game of Enders Gate.

You can take on the first challenge in the series TODAY which is all about promoting GSCs and Enders Gate. The remaining campaigns will be about playing and winning Enders Gate, and will be available on August 21st, when Enders Gate is live.

Start now: https://galxe.com/Findora/campaign/GC1WoUjDU9

🎮 More About Enders Gate

Enders Gate is a turn-based strategy card game where players build and compete with their battle decks. They are developing a mobile version and will soon support #AI-powered opponents, as well as publish a physical comic book.

ℹ️ Info and Resources

Join the Gaxle Event:
https://galxe.com/Findora/campaign/GC1WoUjDU9

Campaign Documentation:
https://docs.findora.org/general-user-materials/gaxle-events/game-chain-challenges/the-campaigns

Announcement Tweet with more info:
https://twitter.com/Findora/status/1691194712919805952?s=20
FRA Staking Issues

The network is experiencing issues with reward claiming and stake unbonding. The issue appears to be related to the latest upgrade to v0.4.3 and Engineering is working to resolve it. Another update will be shared once the issue is resolved.

Thank you for your patience as the team implements a fix.
👍2
FRA Staking Issues (Update)

The engineering team released a new wallet update which appears to have introduced a problem where stake values fail to load. This appears to be purely cosmetic though inconvenient, and requiring that engineering continue working on the issue.

We'll post another update as progress continues to be made.
👍2
FRA Staking Issues (Update)

Engineers have identified issues with EVM operations. One of the symptoms of this issue is missing stake data in the Findora wallet. Validators have also shared information on block proposals which may be tied to the underlying issue. The team is using this information to narrow down the root cause and additional updates will be shared as progress is made.
FRA Staking Wallet Display Issues (Update)

Issue: The Findora wallet is displaying null values for staked, unstaking, and claimable amounts.

Update: Engineers have identified the issue is related to delays with a full node, causing various API calls to load slowly. One of the symptoms more easily noticed is stake values in the Findora wallet. The team is in the process of performing a version update to the full node in question in order to resolve the issue.

No action is needed by wallet users. We'll send another update when the update is completed.
👍3
FRA Wallet Display Issues (Update)

Issue:
The Findora wallet is displaying null values for staked, unstaking, and claimable amounts.

Update [Sept. 28 | 11PM PST]
Engineers have isolated the culprit to performance issues on a full node. To be more specific, the full node is showing that consensus and HTTP/API requests are attempting to acquire a lock on the database simultaneously, resulting in high resource utilization of the server.

With the triggering action identified, the team continues to work on resolving the problem. Once resolved, the wallet will resume displaying balance and stake information, and our tests on the new EVM staking portal can resume.

Thanks for being patient while the team works to resolve this issue. We should have another update by PST morning.
❤‍🔥2👍21
FRA Wallet Display Issues (Update)

Issue:
The Findora wallet is displaying null values for staked, unstaking, and claimable amounts.

Update [Oct. 3rd | 12:15 AM PST]
Our devops team have recently resolve a related issue with a graph node which led to slow performance on the new staking portal in testing. However, this does not resolve the issue where FRA stake, unbonding, and reward values display incorrectly.

The root cause of the issues impacting balances is related to the Findora wallet and block explorer. To be specific, those two products appear to be referencing the wrong API methods for retrieving this data. Because of this, the wallet and scanner are displaying incorrect values.

A solution is underway. Both the wallet and scanner are being updated to ensure the proper APIs are called, which should resolve the issue at hand.

Thank you again and we hope this update was helpful. We will send another update in the morning (PST).
👀2👏1😁1
FRA Wallet Display Issues (Update)

Issue:
The Findora wallet is displaying null values for staked, unstaking, and claimable amounts.

Latest Update [Oct. 3rd | 1:05 PM PST]

1— We have an engineer working on updating the Findora wallet and block scanner. This work should resolve the primary issue above re: the display of stake data.

2— The team also has an engineer who continues to work on the DB lock and performance impact to the full nodes. No new information is available since the last update, but efforts continue to resolve this problem.

3— The Rialto bridge is experiencing issues which should be resolved in the next 24 hours.

The underlying blockchain continues to run and the team is working around the clock resolving the issues above. Additional team members will be joining the effort in a few days when their national holiday comes to a close. Thank you for being patient while the team works to restore some of these services.
👍1
FRA Wallet Display Issues & Portal Blockers (Update)

Issue:
The Findora wallet is displaying null values for staked, unstaking, and claimable amounts. This creates a situation where wallet users have trouble interacting with Findora's staking, and leads to blockers for the launch of the EVM staking portal.

Latest Update [Oct. 4th | 3:45 PM PST]
++++++++++++++++++++++++++++

1— FINDORA WALLET:
Engineering is continuing to work on resolving several issues. On the wallet side, we are updating its API methods used to obtain accurate staking data. Engineers deployed a new version (v0.4.4), but the issue persisted. The team is making progress, and we'll provide more updates as things move forward.

2— STAKING PORTAL:
DevOps is working on resolving issues impacting the full nodes. A new RPC server was set up for interactions with the upcoming EVM staking portal. The DevOps team is reloading the database on this new RPC server to improve staking transaction speed on the EVM staking portal.

3— VALIDATORS:
The new validator jailing threshold has been lowered to more forgiving values. Stake rewards are being generated and accumulating for delegators, but these rewards are not displayed on the wallet until item 1 above is resolved. The engineering team is working on providing node runners with a noscript for manual removal from jailed status. We also will create a way for node runners to check their jailed status via the command line.

++++++++++++++++++++++++++++
As mentioned in the last update, the underlying blockchain continues to run, and the team is working around the clock to resolve the issues above. Additional team members will join the effort in a few days when their national holiday ends.

Finally, and to share more details with the community, we have shared a list of issues being resolved and improvement efforts in progress. We’re working hard to resolve these launch blockers and will share updated versions of the list as progress is made. See image below.

Thank you for being patient while the team works to restore some of these services.
1
Wallet Issues, Staking Portal Blockers, and Improvements (Oct 4, 2023)
Latest Update [Oct. 6th | 5:35 PM PST]

The Engineering team is currently working on fixes to the wallet and has made significant progress on removing blockers to launching the EVM Staking portal.

Each of the issues we’re resolving have specific technical task owners assigned, and task owners are scheduled to meet as a group tonight for a working session. We plan to release an update on the solutions tracker and provide the community with more details once the meeting has concluded.

Rest assured that these are display issues and validator, delegator, and user funds and rewards are safe.
Latest Update [Oct. 6th | 8:50 PM PST]

1— FINDORA WALLET:
Engineering has resolved the issue where balances were not being displayed. This fix is contained in the new v0.4.4 release available on https://findora.org/#wallet. However, a new cosmetic/display issue has been identified where recently unbonded FRA is not reflected in the total balance. Engineering is working on a solution and prioritizing this as an urgent fix.

2— EVM STAKING PORTAL:
The DevOps team made changes which significantly improved response time on the new EVM staking portal. The team is working on a Graph node rebuild. This rebuild will improve response time for other components of the new staking portal which continue to experience a sluggish response time.

3— VALIDATORS:
The engineering team is still working on providing node runners with a noscript for manual removal from jailed status. We also will create a way for node runners to check their jailed status via the command line. DevOps identified some discrepancies on validator profile pages, such as total staked vs self staked. These discrepancies will be resolved with the Graph node rebuild.

We have marked two additional issues as RESOLVED since yesterday’s update and plan keep the community updated over the weekend.
Wallet & Staking Solutions Tracker
October 6, 2023
2👎1😍1
Update: [Oct 7th - 10:40 PM PST]

The Engineering team continues working on resolving issues with the Graph node and full node.

With the Graph node, queries receive no response shortly after the server loads and indexes data. This is likely why testing the v0.4.4 wallet was successful when the previous update was written, but began to fail shortly after.

The full node is showing the local DB receiving lock requests from different processes, causing high system resource utilization and degrading the server's response time.

Fixing the issue for the Graph node and full node will very likely resolve most or all issues with the wallet. I have confirmed again the engineering team is giving full attention to these fixes, treating this with urgent priority.

We'll circle back to everyone with more information tomorrow afternoon (PST) and allow the Engineering time time to focus on identifying root causes and implementing fixes.
🙏2🔥1
Update: [Oct 9th - 10:00 PM PST]

Full Node
The DB lock issue on the full node is suspected to be resolved. However, testing is needed before installing this latest release on a production server. DevOps has the new version, which will go into testing tonight. This fix will improve UTXO functions, such as faster UTXO transactions.

If the new version tests well, the code will be installed into production in the next 24 to 48 hours.

Graph Node
The Graph node database shows an exceptionally high number of connections. This is leading to the Findora wallet displaying incorrect staking information. Engineering is reviewing more debugs off the Graph node to determine what is causing this behavior.

Bridged Tokens
Any tokens locked on the Rialto bridge will be released using a noscript being prepared by engineering in the next 24 to 48 hours. Tokens will be distributed back to the originating address.
Update: [October 10 - 10:00 PM]

Full Node
Last night, we received a newer build for Findora full nodes. However, issues were detected and resolved during testing. DevOps now has a newer build for full node in testing, and all appears to be going well. The team aims to upgrade the full nodes in the next 24 hours.

Note: This full node update will not resolve the incorrect staking balance. However, it will bring added stability to the network and its applications, such as the Findora wallet.

Graph Node
The engineering team has eliminated several potential root causes, allowing them to narrow their focus. They are continuing their debugging efforts. Once the root cause is identified, we can expect a solution in a speedy manner.

The team is working on these issues in real time, and hopes to provide more progress updates tomorrow.
🙏2
Update [October 11 - 10:45 PM PST]

Full Nodes

The DevOps team is testing a newer version that was provided since last night’s update. This version is in testing, and so far, the release appears to be stable.

If the team continues seeing stability, this version will be installed on all full nodes. Validators will not need to update. This is only applicable to full nodes. In the next 24 hours, we’re hoping to deliver news that all full nodes have been or are in the process of being upgraded.

Graph Node

We are seeing significant improvements on the Graph node since our previous update. The engineering team is monitoring the Graph node’s performance, and no issues have been observed in the past several hours. Previous observations showed failure events occurring in short succession of each other, so this is a great sign of progress.

If the Graph node continues showing stability, we can expect the in-wallet staking issues to be resolved within the next 24-48 hours. Like our update on the full nodes, we hope the next update will reflect a working and predictable balance and staking values in the wallet.

Note on Rialto

These issues have also impacted Rialto bridge transfers. Fixes for the Graph and full node should bring Rialto back into full service.

Next Steps

Please continue to monitor the pinned messages for updates. Once these issues are behind us — which should be very soon based on tonight's observations — the engineering team will begin drafting an RCA, which we will share with the community. We will also begin to draft a document detailing changes to our upgrade rollout process, including improved QA testing, internal escalation steps, and more.

We will have an updated Issue Tracker for the community in tomorrow's community update.
🙏1
Update [October 12 - 10:35 PM PST]

Graph Node

The Graph node continues to show stability and correct data. This stability is allowing the EVM staking portal to reliably show valid stake information. While additional QA testing will be needed on the EVM staking portal, this good news brings the portal closer to public readiness.

Full Node

We are continuing to test newer versions for the full nodes, ironing out bugs and improving stability to ensure they do not fall behind. In the meantime, DevOps implemented a workaround that ensures all full nodes are operational and responsive, proactively preventing any impact the full nodes would have on the community. This workaround also ensures that the engineering team can approach their work cautiously while mitigating user impact.

_______________________
Next Steps ⤵️
_______________________

Wallet Unbonded Tokens

Now some good news...

With the Graph node showing stability and the full node workaround in place, unbonded tokens should be reflected properly in user wallets within the next 24 hours. No additional wallet upgrades will be needed. If you’re on a desktop, simply ensure you run the latest release v0.4.4.

Note: Staking FRA and claiming rewards should currently be functional in the Findora wallet. This fix is specifically for unbonded tokens.

Missing Bridged Assets (Rialto)

With the Graph node showing stability and the full node workaround in place, any users who bridged tokens over Rialto and could not retrieve them will find those tokens returned to their wallet in the next 24 hours.
________________________

Below you'll find the latest update to our tracker. We anticipate for the last item in the list regarding unbonded tokens to be resolved within the next 24 hours. I've also added notes for additional context on each item.
_________________________

TLDR: Unbonded tokens should appear in your wallet within the next 24 hours. Staking and claiming in the Findora wallet should currently be functional. Graph node is stable. Full node has a workaround to mitigate impact while engineers continue to work on it. Any missing tokens bridged over Rialto will be shown in the originator's wallet in the next 24 hours. EVM staking portal is closer to public readiness but needs QA after our retrospective is published.
1👍1