{"id":114,"date":"2022-05-14T13:11:02","date_gmt":"2022-05-14T13:11:02","guid":{"rendered":"https:\/\/ozer.gt\/log\/?p=114"},"modified":"2024-01-27T06:58:39","modified_gmt":"2024-01-27T06:58:39","slug":"open-pretrained-transformer","status":"publish","type":"post","link":"https:\/\/ozer.gt\/log\/2022\/05\/14\/open-pretrained-transformer\/","title":{"rendered":"Open Pretrained Transformer"},"content":{"rendered":"<p>Meta AI\u2019s release of Open Pretrained Transformer (OPT-175B), which is on par with OpenAI\u2019s GPT-3 at 175 billion parameters\/weights, emphasizes responsible compute and claims one-seventh the computational cost in terms of carbon footprint. Pretrained model weights are free to download (link in the comments). This is good news for open collaboration and better news for the environment.<\/p>\n<p><a href=\"https:\/\/ai.facebook.com\/blog\/democratizing-access-to-large-scale-language-models-with-opt-175b\/\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Meta AI\u2019s release of Open Pretrained Transformer (OPT-175B), which is on par with OpenAI\u2019s GPT-3 at 175 billion parameters\/weights, emphasizes responsible compute and claims one-seventh the computational cost in terms of carbon footprint. Pretrained model weights are free to download (link in the comments). This is good news for open collaboration and better news for [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"cybocfi_hide_featured_image":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-114","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts\/114","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/comments?post=114"}],"version-history":[{"count":2,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts\/114\/revisions"}],"predecessor-version":[{"id":127,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts\/114\/revisions\/127"}],"wp:attachment":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/media?parent=114"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/categories?post=114"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/tags?post=114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}