Hi Jim,
I started kayak fishing around 6 months ago and have been loving it. I bought a Kayaks2fish Nextgen 10, which is paddle only. It weighs about 25kg and is fairly easy to load on the roof of my car, has good stability and seems to work well in the Hawkesbury and Middle Harbour. There are the usual rod holders, a comfortable seat and rudder straight from the store.
If you are looking for an entry level yak that will let you know if you want to stick with the sport I would recommend the Nextgen 10 as its only $700. I wouldn't take it offshore, but it is great in quieter waters.
Hope this helps.