CoLab Pro

jeudi 12 novembre 2020

I have been using CoLab for quite a few years now and have always really appreciated the ability to get access to GPUs (and TPUs) for free. So when I recently found out about CoLab Pro I was reluctant to pay $10 a month for something I had been getting for free. However, at the same time I was paying hundreds of dollars a month for cloud GPU instances. Last week, after going well over my AWS budget last month, I decided to maybe try CoLab Pro and I am very glad I did.

CoLab Pro gives you priority on high-end GPUs - so far I have never not gotten a V100. This is the same GPU I was paying $0.90/hour spot rate (preemptible) on AWS. For me, the main disadvantage of CoLab was that each instance lasted usually about 10 hours before shutting down, and they would time out if left unattended or if I wasn't at the computer. CoLab Pro instances will last up to 24 hours, and they will not time out. I had one running at work the other day and when I got home I figured it had timed out, but when I went back the next morning it was still running !

Obviously, CoLab Pro is better suited to running experiments than executing long training, and it doesn't support multiple GPUs. And if you are using TensorFlow you have TPUs (I prefer PyTorch.) In the past I have repeatedly kicked myself after spending hundreds of dollars training a model, and then finding a small mistake. In the future I will be running my experiments on CoLab Pro and only using VMs when I am sure everything is correct and I need to train models quickly.

 

Libellés: machine_learning, aws, gpu, colab
Aucun commentaire

Git Through Proxy Server

lundi 11 mai 2020

As of a few days ago they must have changed something in the corporate proxy server at work because all of a sudden no one could push or pull to git remotes. I was getting error "fatal: unable to access [proxy server address]: Timed out"

After much frustration, it turns out there was a fairly simple solution. I had http_proxy and https_proxy environment variables set to the proxy server. If I set an environment variable "no_proxy" with the values of the domains I need to connect to with git everything works fine.

Libellés: git
6 commentaires

Javascript and React

samedi 15 février 2020

In university I was a TA for what they called "third stream computing," which was basically simple computer programming for non-CS people. We covered things like Hypercard, HTML and Javascript, which at the time was limited to things like showing alerts and validating and submitting forms. I think that the idea of Javascript as a very simple and not very powerful language has stuck with me through the years, even while Javascript has been maturing and advancing enormously.

A few weeks ago I decided one morning to spend an hour going through a ReactJS tutorial, because I keep hearing so much about it. After about half an hour I stopped the tutorial and starting rewriting something I was working on in React. Since then I've been doing any web-related work in React and re-writing other web stuff I've previously done in React.

Javascript frameworks like React are going to completely change web development, instead of the back-end serving HTML the back-end will now serve JSON through APIs and the front-ends will probably mostly be Javascript. And in my opinion that's a much better and more efficient way to create interactive websites. Not only is it faster to load and render data on the front-end, but it's much cleaner in terms of code and separating functionality. 

Libellés: javascript, react
3 commentaires

Archives du Blogue