Any expense for business is broadly classified under "Fixed" & "Variable". Fixed expense is referred to as "Overhead" cost as this may reduce the pace of progress. Thus, it has to be the priority always to think and rethink before committing on any fixed expense. A business can excel provided one is light on his / her shoulder with a free mind to think for growth.
Start with a home office concept till you generate some revenue to set up a separate office. It is also better if there is any family member to receive business calls or take note of things if need arises in your absence. In case you are compelled to take a separate office space, keep the cost as low as possible.
Do manpower hiring with care and judge whether the person will be able to do a multitasker job for your business and don't jump for defining job roles till you are sure of the same. People who has exposure of working in MNC and then turned to be a businessman often makes this mistake and end up exhausting almost every bit of his / her earning. Organised approach is good but it's still better to save which is equivalent to money earned.
Work with a laptop even if this costs a bit more than a personal computer for better flexibility. Buy a branded laptop and don't go for an assembled one. This will ensure reputation in front of your client and improve your brand image. Try to get one with 3 years warranty to have peace of mind and will also reduce recurring cost.
Go for telephone connection which gives you better value for money and keep the fixed cost low. Electricity bill often gives headache and hence make sure that lights, fans, air conditioners are put off when not in use. This will also make you responsible citizen at large.
In case you intend to take a loan for meeting your business expenses, avoid using credit card as a source of finance. The rate of interest can range from 30% - 45% per annum depending on the bank. Apply for a business loan instead which is an unsecured loan and compare rate from at least 2 / 3 banks. The banks will generally offer a rate between 13% - 17% per annum which is still better for a start up in case you don't have an alternative source of finance. Don't put all your earnings into business. Take a bigger repayment time frame so that you are comfortable in repayment.