What is the hardest tasks a programmer can have? “The results were based on 4,500 votes developers provided on Quora and an older Ubuntu Forums thread.”[2] is shown here: It is beyond expection that people putting the naming things as the hardest task. Actually, it is true as a not clear name will greatly reduce the readibility of your code. Meanwhile, a good naming will make the code speak out for itself and with as less confusion as possible. As usually, we don’t want to spend that much time to think about a good name, it makes the naming can be a significant part to distinguish a solid SWE or a relative junior SWE. If you wanna improve your naming skills, read the clean code book[3].

in this article, I will skip how to install the OpenAI Gym. Please check the offical website. Basic usages From [1] Check the number of environment available. Code Output In total we have 790 envs available! The first 4 envs are: -------------------- EnvSpec(id='ALE/Tetris-v5', entry_point='gym.envs.atari:AtariEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=27000, order_enforce=True, autoreset=False, disable_env_checker=False, new_step_api=False…

Proximal Policy Optimization (PPO) is a popular algorithm for Reinforcement learning. In this article, I will put some tutorials I feel helpful during my learning process. A general RL tutorial summary can be found here Must see Please check [1][2][11]. In case you understand Chinese, there are some tutorials in [2][5][12]. Further reading about the first author of the PPO algorithm See…

Question PyTorch is quite easy to use, however, we can also find researchers are using PyTorch Lightning. It must has some reason. Why? Answer Selling points are well summerized from the official webset Quick summary of what PyTorch Lightning is doing from [4] In summary, the LightningModule groups the core ingredients we need to build a deep learning system: The computations (init…

I’d like to put the resources regarding the Kalman filter in this article. Videos Understand & Code a Kalman Filter [Part 1 Design] Understanding Kalman Filters, Part 1: Why Use Kalman Filters? Papers Tutorials See [1] and [2] Kalman Filter from professor Xu Kalman Filter tutorial by David Kalman Filter in Chinese[4] Kalman Filter in Chinese [6] Quick explanation From here[5] in Chinese. Please use google translate to get the English version.

Question A question was asked here which is also the question I want to know the answer. A map-style dataset in Pytorch has the __getitem__() and __len__() and iterable-style datasets has __iter__() protocol. …