Problem The iphone storage is full and my iphone 13 got stuck on the home screen when asking me to input the passcode. Solution Previously, I had a similar issue and when I went to Apple store, they reset my iphone and of course all unsaved images and videos lost :( This…

Which testing tools that we can use for python? As a software engineer, it is a common practice to add test cases for your software and program. General, we need Unit Tests and Integration Tests. [5] gave a pretty clear explanation. We have 3 ways to run python tesing. unittest nose or nose2 pytest Originally, I was using pytest, it is pretty convenient. However, I got quite a lot of Moudular import error, especially in the docker environment. So I switched to unittest and there is no issue. If you wanna to know how to use the “unittest”, please check [5].

A reinforcement learning practice — What is stable_baseline3 ? stable_baselines3 is a Reinforcement Learning Implementation package developped by awesome researchers and engineers from Germany, France, USA and Finland as you can discover from the author list based on the paper:

What is the hardest tasks a programmer can have? “The results were based on 4,500 votes developers provided on Quora and an older Ubuntu Forums thread.”[2] is shown here: It is beyond expection that people putting the naming things as the hardest task. Actually, it is true as a not clear name will greatly reduce the readibility of your code. Meanwhile, a good naming will make the code speak out for itself and with as less confusion as possible. As usually, we don’t want to spend that much time to think about a good name, it makes the naming can be a significant part to distinguish a solid SWE or a relative junior SWE. If you wanna improve your naming skills, read the clean code book[3].

in this article, I will skip how to install the OpenAI Gym. Please check the offical website. Basic usages From [1] Check the number of environment available. Code Output In total we have 790 envs available! The first 4 envs are: -------------------- EnvSpec(id='ALE/Tetris-v5', entry_point='gym.envs.atari:AtariEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=27000, order_enforce=True, autoreset=False, disable_env_checker=False, new_step_api=False…

Proximal Policy Optimization (PPO) is a popular algorithm for Reinforcement learning. In this article, I will put some tutorials I feel helpful during my learning process. A general RL tutorial summary can be found here Must see Please check [1][2][11]. In case you understand Chinese, there are some tutorials in [2][5][12]. Further reading about the first author of the PPO algorithm See…

Question PyTorch is quite easy to use, however, we can also find researchers are using PyTorch Lightning. It must has some reason. Why? Answer Selling points are well summerized from the official webset Quick summary of what PyTorch Lightning is doing from [4] In summary, the LightningModule groups the core ingredients we need to build a deep learning system: The computations (init…