Secondy you can stay with BizHawk, using the client.screenshot() function to save a .png and then immediately load it using some Lua library or your own functions decoding the image, reading the pixels etc. Finally you can also simply get values from RAM that tell you the position of Mario, enemies and obstacles. But this might not fit into your computer vision methods since they don't give you pixel data. So this would result in a different kind of AI.Language: lualocal srcn = gui.screenshot_bitmap() local pixelcolor = srcn:pget(152,168) -- x:152, y:168
As to things you can do with that, looking at the code for the LuaCanvas, you can use SetTitle(), Clear(), Refresh(), DrawRectangle(), and DrawText(). So like:Language: lualocal myCoolCanvas = gui.createcanvas(640,480)
Language: luamyCoolCanvas.DrawText(10,50,"sup") -- default color is white so might be hard to see myCoolCanvas.DrawRectangle(64,32,16,16)
Are you sure? Related: http://tasvideos.org/forum/viewtopic.php?t=18128
Language: lualocal moviepath = "movie.dsm" local function getTime(newtime) local s = newtime%60 local m = math.floor(newtime/60)%60 local h = math.floor(newtime/3600)%24 return string.format("2009-JAN-01 %02d:%02d:%02d:000",h,m,s) end local function editFile(newtime) local file = io.open(moviepath,"r") local filestring = file:read("*a") file:close() filestring = filestring:gsub("(rtcStartNew )([^%c]+)","%1"..getTime(newtime)) file = io.open(moviepath,"w") file:write(filestring) file:close() end local function checkResult() if memory.readbyte("0x02000000")==0xFF then return true end return false end local newtime = 0 while true do editFile(newtime) movie.play(moviepath) for i=1,7000 do -- frames to wait emu.frameadvance() end if checkResult() then print("it worked with "..getTime(newtime)) end newtime=newtime+1 end
---------------- DeSmuME is interesting in that it constantly redraws the screen even when paused. I'm assuming your code looks like this:Language: lualocal function main() gui.text(10,10,"hi") end gui.register(main)
The point is that you are using the gui function once a frame, but the screen is redrawn multiple times per frame. The solution is to tell DeSmuME that you want to keep drawing when it draws the screen, with gui.register():Language: luawhile true do gui.text(10,10,"hi") emu.frameadvance() end
Language: luagui.register(function() gui.text(10,10,"hi") end)
If the fact that portal was up for consideration was mentioned literally anywhere in this thread (that I checked multiple times leading up to the event), I would have gotten in contact with you and written/practiced something. Instead the run commentary was essentially "here you fly across the room because cameras and portals".
